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This, thesis expiores a new Lormulation ot the robot planning 
problem ia terms of dynanic logic (DL). The gweneratl form otf a 
Planning, problLen is to find a sequence of actions which will 
transforr a set of initial wortd states into a set of weal states, 
where a set ot states is usually described by a logical formulae 
Farly researchers reduced vplanning to theorem provanEe in a 
tirs:it-orcer Language called the situational calculus (McCarthy and 
Hayes 6 }. Tnis approach ofters a well-defined Semantics tor plans 


(namely, any "Standard" semantics ot first-order lcopic), a rich 


vocabulary for describing, world states; and a provably correct and 
complete tlanniny process. But the situational calculus has nothing 
to say abuut how tne search tor ;lans is structured, without such 


contro! knwowledie;, a planner is nopelessly inefficient. 


The STRIPS series of planners (Fikes and Nilsson 71) 


concentrated on such efficiency issues, but neglected many of the 


positive features of the tpurely lopwical" approache world 
descriptions were limited te conjunc tions of literals, making 
disjunctive and quantitied knowledge inexpressible,; actions were 


defined by Simple syntactic operators ("add lists" and "delete 


lists") which Lacked clear sSemanticSe 
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Stanley Rosenschein has formulated planning in propositional 


dynemic logic, a noda | logic developed tor program verification 


[Harel 79] [Pratt 76]; and has piven a complete thigression" 
alpori thn ("bidirectional progression and regression") for 
synthesizing a broad class of plans [{Rosenschein S&1]-« As in the 


situatioral calculus, actions are described hy lowzgical axioms, 
leading to provably correct plans; as in STKIPS, an explicit 
algorithm structures the searche The framework naturally and 


elewantly handles conditional actions and hierarchical planse 


{ will define a first-order dynamic logic suitable for stating 
planning problems, and extena Rosenschein's algorithm to handle a 
subset oi the languave.e Much of the work centers on calculating the 
effect otf a possibly non-deterninistic action upon our knowledge of 


the world when the simplifying STRIPS assumptions are abandoned. 


Many problems which are difficult to even state using 
STKIPS-like operators can be readily solved by a Di-planner.e The 
familiar blocks-world repertoire is immediately expanded to include 
disjunctive yoals, as in the command, "Build a red tower OF a blue 
towere" beduced information is no longer problematical. Given 
axioms to describe the predicate NEXTTO in terms of ON, no special 
rules are needed to "delete" NEXTTO(BLKi, BLK2) from the world 
description when CN(BLKL, BCX2) or ON(BLK2, BOX3) becomes talsee 
Bound variables may appear in goal or action descriptions, as in 
"Put SOME red block in the box, and keep ALL the others in place", 
or "The action IRRADIATE(x) sterilizes ALL the fruit-tlies im dish 


ny 


xe"! 
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Consider the "J3J-socks" problem. You stand ina lightless room 
before a dresser tull of loose socks, some black and some whitee 
How many socks must you pull from the dresser before you can be sure 
that you have a matching pair? Not only is the goal inaefinite -- 


get two black socks OR two white socks, and I don't care which socks 


in particular —— but the "Hull out a sock" action is 
non-deterministic.e Yet the problem is solvable because its 
non-determinism is constrained in a known way: the sock will be 


distinct from those obtained earlier and will be either black or 


whitee 


DL-action axioms can encode more information about "puli out a 
sock!!! than can any simple add-list/delete-list paire It is 
unlikely, of course, that any tinite representation wiitl succeed in 
capturing all conceivably relevant ettfects of a real-world action. 
It is important, therefore, that the representation be monotonically 
extensible. Every DL-axiom specifies some partial effects of an 
actions; unless the system is made inconsistent, adding more axioms 
will never invalidate an old plane The opposite iS generally true 
of STRIPS; one is forced to to add new actions rather than 


redefining old ones if compatibility is to be retainede 


The price the DL approach pays for its flexibility is the need 
for "frame axioms", axioms which specify all the predicates which a 
action does NOT affect. But trame actions are useful for describing 


actions with possible side-~effectSe 


This thesis shall not concentrate on particular heuristics for 


choosing “good" actions when building a plane Instead, two classic 
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Aele techni.yues for reducing the size of the search space Shall be 
applied to the DL frameworke The first involves merging branches of 
the Search tree by allowing incompletely-Specitied actions in 


partial plans [Sussman 7£J. 


Perhaps the greatest efficiencies can be obtained through the 


use of plan hierarchiese This iS commonly implemented (eg, ALBSTRIPS 


[Sacerdoti 74] and NOAH [Sacerdoti 77]) by temporarily hiding “less 
important" details from the planninzy, unit; when the details are 
filled in, the plan may be in error and must be patched Upe The 


complexity of the patching process, unfortunately, weakens our faith 
in the ultimate correctness of the plan ad the overall efficiency of 
the strategye The DL framework, on the other hand; Sugwests an 
exact hierarchye The basic actions on one level are Simply planning 
problems to be solved on lower levelse A subplan is guaranteed not 


to unexpectedly clash with other parts of the high-level plane 


i consider "ood" decompositions of the blocks and 
"dungeons" worldSe One can Specify how "general" a sSubplan should 
be, balancing the jyossibly higher cost of finding a very general 


plan against its greater potential for reuse. 


Finally, L'1ll discuss some further extensions ot the language 
and the algorithn. The systen has not been implementede The 
immediate concern is to demonstrate that the method is sound, and 


potentially better than anything currently available. 


CHAPTER: 2 


INTELLECTUAL ORIGINS 


In its broadest sense, "planning" incorporates what might be 
taken as the task ot artitical intelligence: 
eewe want a computer prozram that decides what to dao 
by inferring in a formal language that a certain 
strategy will achieve its assigned goale [McCarthy 
and Hayes 62] 
An intelligent prograw must possess an adequate representation of 


the world, including: its own deSires and abilities, and e mechanism 


for applying its Knowledge to solve the problems at hand. 


much work has been done on robot planning systemse In the 
classic scenario, the system guides a robot in manipulating objects 
in a very Simple model of the physical worlde The problem presented 
to the system is to devise a sequence of actionS, a plan, which will 
transform a viven initial state into a goal statee The robot is the 
only active entity; its knowledge ot the world is simply identified 


with the representation chosen for states and actionse 


[In recent years, exciting research has proceeded toward a more 
peychologicalily sophisticated theory of planning, for example, see 


{Cohen 7&8) [Moore 80] [Haas 81]. Prolegomena to the specification 
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of any pianning systew, however, are the questions: 


--Whot formally is a plan , a planning problem, and a solution? 


--How is the search for solutions organized? Is the strategy 


provably correct? 


--For what class of problems is it complete? 


Rosenschein's work provides an elegant set of answers which 
unify and clarify the approaches adopted by a number of earlier 
methodologies. This chapter brietly describes some of these 
influences and summarises (with very minor adjustments, to lead more 
smoothly into the extensions of chapter 3) the framework presented 


in [Rosenschein 8&1]. 


2el SITUATIONAL CALCULUS 


A situation s is the complete state of the universe at an 
instant of timee A first-order Logic which allows situations to be 
the values of terms is a situational calculus. [McCarthy and Hayes 
62] provides a discussion of the philosophical underpinnings of the 
use of situations to describe action, causality, and ability. 
(Green 68a] reduced robot planning to theorem proving in a version 


ot the situational calculuSsSe 


Each predicate takes an argument specifying a Situatione For 
example, "on(4,B,S1)" asserts that (the entity denoted by) A is on B 
in situation Sl. Some itunctions evaluate to actionse "Mcve(A,B,C)" 


is a term which stands for the action of moving object A from 
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The function "result(a,s)" maps a state s and an action ae to 


the state resulting from performing the action in Se 


A planning problem is formulated as follows. The initial state 
is described by a wff all of whose predicates include some arbitrary 
Situation SC. The desired tinal state is described by a wtf whose 
common situational variable is existentially gquantitiede The 
problem is to find a constructive proof that the second wit follows 
from the first ~-- for example, that 

on(A,B,S0O) > Es onl(A;Cys) 
-- using a set of axioms which Specify the results of the actionSe 
An axiom for move might be 


¥Vsxyz ((on(x,y,s) A Location(z)) > 
on(x,z;, result(move(x;y,z), s))) 


A constructive proof the problem wff actually finds the Situation Ss 
such that on(A,C7S)e- In this case, 

on(A,;B,S0O) > on(A,C,y result (move (A,ByC),S0)) 
Thus, the plan to achieve on(A,C) given on(AyB) is to perform 


move(A,B,C) e 
Praiseworthy teatures of this approach include: 


A solution to a solvable problem can be guaranteed to be found 
if a complete first-order proof strategy (such as resolution with 


answer-extraction [Green 69b] ) is employede 


Correctness of plans is obvious, froin correctness of the 


underlying proof proceduree 
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A well understood semantics exists (namely, any typical 


semantics for first-order logic) for plans and planning problemSe 


There is extreme fiexibility in stating axioms and planning 
problems; there are no inherent objections to including 


quantifiers, disJjunctions, additional functions, etce 


Yet the situational calculus says nothing about how the search 
for solutions is structured. Without adequate control knowledge, 


any theorem prover will be excessively slowe 


Axioms must specify what each action does not changeée In order 


to derive 
(on(Ay,SO) A location(C) a on(D,E;SG)) > 
(on(A,C, result(move(A,B,C),SO)) a 
on(D,E, result(move(A,B,C),S0))) 
an axiom is required to the effect that an object not being moved 


stays in the same place: 


¥svwx3 z ((on(vyew,s) A w#x) OD 
on(vyw, result(move(x,y:z);s))) 


The computational problem of dealing with a large number of such 


oe Se ee ee 


Finally, the notation is rather awkwarde One may also feel 
that the treatment of Situations, actions, and objects -- all merely 


elements of the domain of interpretation -- is overly homogeneouSse 
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A tamily of situations can be modeled by a logical formula, its 
state description. Keer on(A,B) represents all situations where 
(the entity denoted by) A rests on be Planning can be pertormed by 
searching; the Space of state descriptions, for a path trom the 
initial state ee Danio n to one which entails the gcal descriptione 
Actions are modeled by operators which change one state description 


into anothere 


The STRIPS series of planners [Fikes and Nilsson 71] avoided 
the frame problem by Limiting state descriptions to sets 
(conjunctions) of literals, and representing actions by syntactic 
operators which transformed descriptions by explicitly adding and 
deleting propositionse For instance, the move operator can be 
written 

move(xry7z) 
gErecondition List: on(x,y) 
add list: only ,z) 
delete list: on(xyy) 
The instantiation move(A,H,C) af move can only be applied to state 


descriptions containing on(A,B), and its eftect is to replace that 


proposition with on(,C). 


STRIPS decouples search from theorem proving. Theoren proving 
is enployed within a state description to discover what operators 
are applicable; and what woals have been achieved. search is 
directed by a means-end analysis algorithm [Newell and Sinon 63]. 
An operator is chosen whose eftects (add list) reduce the difference 


between the goal and the current state descriptione If the operator 


is applicable to the current state, it is immediately applied; 
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otherwise, its precondition becumes a new goal to be achievede This 
“hackward-chaining" search is poal-oriented;,; but state descriptions 


are always developed in a forward directione 


STRIPS' nandling of conjunctive and disjunctive goals is tairly 
weak. It tries to achieve each literal in a conjunctive goal ina 
linear order; if an already~achieved goal is undaoney, planning is 
reattempted with the Literals ina ditferent ordere STK IPS always 


attempt to achieve one disjunct of a disjunctive goale 


STRIPS made great strides in efticiencye But the non~- logical 
nature of its operators make at difficult to formally prove the 
correctness or completeness of the system, indeed, its strategy is 
demonstrably not complete. The frame conditions for actions with 
possible side effects, so-called influential operators {Waldinger 
Daas can be too complex to be represented by the STRIPS default 
rulee Nor is it alwayS reasonable to assume that the machine's 


Knowledge of the world can always be represented by a conjunction of 


literals. 


A problem solver can also search by transforming the goal 
description, in Stages, to the initial state description, by 
applying the inverses of the action Operatorse Passing a 
relationship back through an operator is called repressione An 


uninformed torward or backward breadth-tirst Search can be the basis 


for a complete planning strateey [Nilsson 80]. 


The RSTRIPS systen [Waldinger 77] improved STRIPS! handling of 
conflicting conjunctive goalSe When an attempt to achieve a 


particular goal literal interferes with an already achieved pyoal, 
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the offending ocal literal is regressed back through the 
partially-constructed plan, in the hope that it will be easier to 
achieve’ at an earlier point in the plane Its coverage of the 
Solution spacey however, is still incomplete and not completely 


characterizede 


The REFLECT planner [Dawson and Siklossy 77] did pertorm jpure 
backward searchy regressing entire goal descri;ytions, without 
focusing on achieving particular goal literals. Simple STRIPS 
operators and pruning heuristics (similar in spirit to those that 


appear in Rosenschein's algorithm) allow REFLECT to solve problems 


requiring fairly long solutions. 


2e3 HIERAPCHICAL PLANNING 


The space searcned by a vpeneral planning system tends to grow 
exponentially as the distance between the initial and yzoal states 
increaseSe Various approaches reduce search by asserting a 


Wyertical"™ control etructuree 


The creators of STPIPS experimented with using Beneralized 
versions of previously solved plans as "macro operators", or MACROPS 
(Fikes, Hart, and Nilsson F2). A MACROP- provides a short-cut 
through the search space -- if the system is so tortunate as to have 
previously solved a problem which is a current subtask. REFLECT 
systematically comb ined primitive operators into BIGOPS during a 
preprocessing stagee For exanple, an operator to pick up a block, 
and an operator to stack a block being held on top of another, are 


paired in the BIGOP "“pickupaAstack". If the planner only uses paired 
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KIGOPS, the Search space is cut in half. MACFOPS and BLGOPS care 


simply expanded at plan execution timee 


MACROPS and BIGCPS preserve all the preconditions ana effects 
of their component operatorse {Sacerdoti 74) argues that the 
retention of detail greatly linits the heuristic value of such 
simplifying representationSe A hierarchy of abstraction spa 
should model the world and actions in less and less detail. A 
short, abstract plan can be quickly found at the least detailed 
levele Subtasks are created at the next level of detail to link the 
steps of the abstract plane Only at the bottom of the hierarchy are 
all the facts known to the planner considered; but thie search 
remains eitficient, as it is tightly constrained by the more abstract 


plan. 


ABSTKIPS [Sacerdoti 74] and NOAH [Sacerdoti 77} implemented a 
small portion of this philosophy by selectively ipnoring action 
preconditionse In ABSTRIPS, preconditions were assigned criticality 
valueSe At abstraction level N, the operators are sinplified by 


disregardiny,, preconditions valued less than Ne The planner 


repeatedly patches the abstract plan, so that it remains correct for 


NOAH represents actions by procedureS, and permits a dynanic 
hierarchy , but the approach is basically the the Same: some 


preconditions are initially iznored, and the initial rlan is 


heuristically patched up. 


A "detail", however, is not necessarily an unimportant detail. 


The patching process can simply fail at any level. The planner 
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could try to come up with another abstract plan -- but would have no 
4 


&auarantee that this second attempt would not be unfixable as well. 


Again, no formal description of the planning systems or the 
precise relationship between the levels oi the hierarchy was ever 


presentede 


2e4 PLANNING IN PRCPOSITIONAL DYNAMIC LOGIC 


Dynamic logic is a tool for reasoning about binary 
state-relationships induced by computer programs, developed by 


workers in proiram semantics and verification [Harel 79] [Pratt 76]. 


{ Rosenschein 81) formulated planning in terns of propositional 
dynamic logic, explicitly equa ting. the notions of i ae and 
“program, Plans are allowed to contain tests and conditional 


seguences of actionSe 


A dynamic logic is a modal logic: a plan is a reachability 
relationship over ae set of possible worlds. {If A is a plan, [A] 
corresponds to a "necessary" modality; (AJp is true in a world I if 
p is true in every world reachable from I by Ae So [A]p can be 
read, “after A, p". Sipiitearl ys, <A> corresponds to a "possible" 
modality; <A>p is true in a world [ if p is true in Some world 
reachable irom I by Ae The fact that the box and diamond modalities 
are distinct intuitively iuplies that plans may be 
non-deterministic.e When p P{LAJ]qy holds, we say "p is a (sufficient, 
but perhaps not necessary) precondition of A and q" and "q is a 


postcondition of p and A". 
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A loop-free subset of propositional dynamic logic is defined as 


follvuws: 


2e4el Syntax 


A dialect of PEL is specified by its atomic propositions PROP 
and atomic actions ACTe Define Wffs and Plans over <PROP,ACT> 


inductively by: 


1. If ~~ e PROP then p e Wtfs 

2e It a e ACTS then a € Plans 

Je If peg € Wifs then -~p, pv gq € Wtfs 

4. {f gp e Wifs and A e€ Plans then <A>p e Wifs 

Se null e¢ Plans 

be {If p e Wffs and nonmodal, and A,B € Plans, then 
A;B , A U By and p? e€ Plans 


A wff is nonmodal if it contains no subformula ot the form 


<A>pe Abbreviate: 


a(rp Vv aq) as pa gq 
apvg as Bp > q 
a<A>n as [LA] 

(p?;A U 7p?;B) as (p ~ A,B) 


The form (p 7~A,B) represents the conditional, IF p THEN A ELSE B. 
The form A;B represents the sequential execution of A then Be We 


write A;B3C inditferently for (A;B);C or Aj; (B3C)- 


20422 Semantics 


The semantics described here are a subset ot the first-order 
semantics presented in the next chapter, rather than those which 
appear in [Rosenschein 81]-e A structure tor PDL contains a set of 


worlds WD and a function m which interprets each atomic action as a 


binary relationship over WD (ieeo,s a Set of pairs of worlds). Each 
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world assigns a truth value to the atomic propositions; if p holds 
in world Il, write I |=. Mutually define truth for non-atonic wfts 


in a world I, and a meaning function M for general plans: 


Truth of formulas 


I]= -p iff not I|=p 

Dileep v gq iff I]=p or I]=q 

I]= <B>p iff exists J e€ WD such that 
(IeJ) € M(B) and Jj=p 


Meanings of Programs 


M(a) = m(a) for a e€ ACT 
M(null) = ((1,1) | I e€ WD) 
(identity relation over WD) 
M(p?) = ({(I,r) | Ll= p} 
(identity relation restricted to worlds 
where p holds) 
M(A;B) = m(A) o m(B) 
(composition of relations) 
M(A U B) = m( A) u m(B) 
(union of relations considered as sets) 


A structure satisfies a wff if the wff is true in every world in the 


atructure. A valid wtf is satisfied by all structures. 


2042-3 Axiomatics 


Take A and B to be any Plans; p and q to be any Wftfse A 


complete axiomatization of uninterpreted loop-free PDL is given by: 


Axioms 


1- Axioms of propositional calculus 
2. [A]l{p > gq) 2 (LA]p > [Al]q) 


Je (nulljp 2p 
4. [p?P]q = (p > q) 
S.- {A;B]p 


b 
CAJ(BlJp 


Cee ke Bie (LAlp a [B]p) 
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kKules ot Interence 
From p, p2®q derive q 
From p derive [A]p 
Write tp if p is provable fron these axioms, and Gtp if p is 


provable fren tne axioms augnented by some set of wifs Ge 


2-4.4 Nornal Form Flans 


A plan in which the "?" (test) and "yt (non-deterministic 
choice ) operators are only used to construct conditional forms 
(p ~ AygB) is a C-Plane A plan B is in normal form if: 


(i) T! can be written as Als$A2j;e4e563An with at most one Ai not 
atomic, and 


(ii) Such an Ai is of the form (t+ ~- B1,B2), where t is an 
atomic proposition, and Bl and B2 are in normal forme 


Any C-Plan is equivalent to a C-Plan in normal forme A set of 
meaning-preserving transformations that can be used to put any 
C-Plan in normal torm is easily found; for example; 
(ap 7 Ayk) becomes (p£ —~ B,A) 
(p v gq — Agi) becomes (p ~ Ay(q > AygB)) 
(p ~ B1,B2)s«e03(q ~ B3,B4) becomes 
p ~ (Blsecesl(q ~ BI, 84)), (B2;00ee5(q ~K3,B4) ) 

Wefll only look for normal form plans as solutions to planning 
problems .e [The following discussion is Simplified by informally 
identifying, the null action with a plan of length OR and taking 
Asnull = null;A = A for any pian Ae (It is obvious, otf course, that 


the interpretation ot the three strings above is identical.) 
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2-4.5 Defining A Planning Problem 


If r describes some initial state, and s describes some goal, 
the wff 
r > [A] s 
clearly asserts that A is a plan for achieving: Ss given Le 
Similarly, if a is an atomic action, one may write 
Pp > lal] q 
to assert that p is a precondition for using a to achieve de 


Kosenschein defines a planninz problem as a triple <VOC,G;RES(u)> 


SoS = ee = oe oe 


where 
1. VOC = <PROP,ACT> is the vocabuiary of the problem. 
2e Gisa finite set of axioms, the domain constraints. It 


contains: 


Gs; a set of nonmodal, or static constraintse 


—— See 


Gd, a set of dynamic constraints, which specify (perhaps only 


SS ee 


in part) the efitects of the atomic actionse Each dynamic axiom 
is of the form p 2[La] q; where p and q are nonmodal and ae is 
atomice 


3.e PES(u) is a finite set of tormulae called the plan constraints. 


Eact. _is ot the form r 2({u] s where r and S are nonmodale "Wol ais a 
Special syntactic variable which doeS not appear in VOC. 


A solution to such a planning problem is normal-form plan B (in 
the dialect VOC) such that substituting B for u in each of the plan 
constraints creates a formula derivable from the domain constraintse 
That is; Gt r 2[B)] s for each tormula r 2[u]) s in RESe Solutions 


can also be characterized semantically: structures that satisfy the 


domain constraints also satisfy the B-instantiated plan constraints. 
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264-6 A Planning Algorithm 


Rosenschein suggests that the search for solutions to a 
planniny problem be organized by the syntactic structure of the 
planning, (provyramming) languagee Suppose we are looking for a 
norma L fornr plan A that satisfies one of the plan constraints 
r DPL[A]s in FKESe Consider the following cases corresponding to the 


erossible forms of A: 


nulle This is a solution if Gt rDsae 


a 

e 

> 
i 


Ww 
e 
> 
i 


a;B or A= Bsa for Some atomic action ae In the tormer 
case, A is ae solution ir Gt rfa ®2([B]S, where r/f/a represents the 
strongest provable postcondition of r and ae Analogously; in the 


eet ame cae en Gee 


second casey, A is a solution if Ct r 2{BjJaX\s where aXs is the 
weakest provable precondition of a and Se We call the former case 
“poregression"™ and the latter "regression! . 

S54 = t- B1l,B2. In this case, A is ia solution if 
Ge (r a t)>[31Js and Gt (r an at)>r[B2Js. 
Case (1) derines success, (2) suggests forward and backward 


strateygies for sequential steps, and (3) suggests a forward strategy 


tor conditionalse 


There are a nunber of Simple ways of pruning the search treee 
First, if r>r/ay, the forward search need not consider action ae 
(Intuitively, a would not achieve anything that does not already 
hold in re) Dually, if a\s>s, the backward search need not consider 
Ae (a\s describes a voal which is harder to achieve than Ss ae 
perhaps impossible, when as is false.) These check eliminate 
self-loops; as described in chapter 4, they can be extended to 
eliminate all loogs in the search sSpacee Finally, if r>t or ro2nxt, 
it is net necessary to pursue the forward conditional search 


involving t: the test uncovers no new intformatione 
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These observations lead to the following nondeterministic, 
bidirectional search algorithm.* The Single constraint r>[uJs is 
solved for by calling WIGRESS(r,s). 


BIGRESSTON ALGCRITHM 


HIGRESS(r, s): 
If Gt r>s then return( null ).e 
Choose: 


Choose <a, r/a> from LiveForward(r); 
return( a;BIGRESS( r/a, s ) ). 


Choose <a, a ts> from LiveBackward(s) 3 
return( BIGRESS( r, a xs )ja )e 


Cheese t from NontTriv(r); 
return( t - BIGRESS( ra ty, s ), 


DIGRESS( rr A mt, Ss ) )e 
ende 


LiveForward(r): 
return { <a, r/a> | a € ACT, G¥ r>r/a). 


LiveBackward(s): 
return ( <a, as> | a € ACT, G¥ a srs). 


NonTriv(r): 

return ( t | t € PROP, GY p>t, GK pro-at) 
The algorithia still presents a fairly abstract view of the planning 
process; it says nothing about the particular order in which 
"“choices"" are made, when backtracking is invoked, etce (lt one of 
the subproce:rlures returns an empty set at some point, that choice is 


obviously prohibited-e) The extensions to BIGRESS to handle multiple 


*Rosenschein's original statement of the algorithm ditfered by using 
two additional parameters to pass the partially constructed plan to 
each recursive instance of BIGRESS.- The innermost instance returned 
the entire plane 
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constraints are discussed alonw with the tirst-crder extensions in 
chapter 4e We now discuss how the provability test, "Gt", and the 
progression and regression functions, wy" and w\", can be 


implement ece 


204-7 8 Provability; Proszression, And Regression 


It is notoriously difficult to mechanize modal proof systems; 
the auxiliary functions are implemented using only ordinary 
propositional decision methodse The key requirement is that the 
nonnodal akions GS} be strong enough to generate all nonmodal 
formulae eenerated by all of Ge Rosenschein does not present a 
proof that this condition can always be enforced, while Gs remains 
finite. bection 4.3 discusses some of difficulties that arise in 
the first-crder casee We Simply take it on faith that this 


requirement is mete 


The test "GE" is only applied to nenmodal thormulas pe Given 
the above caveat, this is equivalent to Gstp, which can be checked 


by a standard propositional theorem provere 


Now, quoting [Rosenschein 81]: 


The formula v/a is tound by taking the conjunction of 
the set of formulae each of which is a disjunction of a 
set of qi taken frum the "right hand side" of the dynamic 
axious of G (pi >LaJqgi) such that the dis junction of the 
corresponding pi'ts is implied by r-. Dually, a\s is found 
by taking the disyunction of the set ot formulae each ot 
which is a conjunction of a set of pi drawn trom the “left 
hand si-fe" of the dynamic axioms of G such that the 
conjunction of the corresponding gi'ts implies s. 


Consider the following Sample axioms: 
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A >faj) (b v Cc) 
G >[a] -~B 
CEeeee) Stal] Dd 
In this case, a\lC v D) = (A a G) v (Fa EB). The reason 
for this is that (BB v C) conjoined with -—B implies (C 
v D), so the conjunction of the corresponding lett-hand 
Sides (A a G) is one disjunct of a\(C v D)e Likewise, the 
formula D alone implies (C v D), making the corresponding 
left-hand Side (F oA E) the second disjunct. These two 
cases exaust the possibilities for getting (C v D)e 
Rosenschein does not present a proot that "/" and “\" as outlined do 
indeed calculate the strongest provable postcondition and weakest 
provable preconditioane Section 4-5 of this thesis shows the value 
ot r/a is a post condition, but stijll lacks a proot that it is the 
strongest postcondition; and similarly for aX\sSe Nonetheless, Ly ad 


will continue to be used for stongest provable postcondition, and 


"WA" for weakest provable precondition. 


The description of "/" and "\" suffices in the propositional 
tramework because there is only a finite number of dynamic axioms. 
One may sSirply form all possible dis junctions of the “lett hand 


sides'"', for example, and test whether they are implied by Se In the 


first-order case, we have to deal with dynamic axioms containing 
quantifiers, and explicitly discuss how formulae containing 
variables are proyressed and repzressede In order to extend the 


propositional techniques, we must be able to determine all the 
relevant "instances" of the quantified dynamic axioms, the main 
work of this thesis is to show how a proof method Known as "answer 


extraction" can be employed to this ende 
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240d Hierarchical Planning 


The key observation in extending the single-ievel alyorithm to 
multi-level, hierarchica] planning is that an atomic action at level 
k is a plan to be solved at level ktl. This point of view is 
possible secause of the way the planning problem was forralizede 
The syntactic form of a dynamic axiom in Gd is precisely the same as 


a plan constraint in RESe 


Formally, a hierarchical planning problem is a tree of 


single-level problemse Ig <VOC =<PROP , ACT >, G » RES (u ))> is 
k k k k k kK 
the problem at non-leaf node kK, then node k has one successor for 


each, a in ACT , and that successor's problem has the form 
kyi k 
<VOC 9C 1G'(a )> where G' denotes the subset of dynamic axioms 
Kk+t1 kt+d1 k,i 
of G having the form p>[a ]qe In other words, the domain 
Ic Kyi 


constraints on the primitive "a" at level k become plan constraints 
at level k+1e An overall solution is then a plan using the 
vocabulary cf the leaf nodes that satisties the requirements of the 


root nodee 


For any node ky, only the Successor nodes corresponding to 
actions actually used in the solution need be solvede Furthermore, 
the existence of a solution tor each of these nodes guarantees the 


w 


existence of an overall solutione The relationship between levels 


in the hierarchy is precisely defined as “correctly implements". 
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204-9 Sunnmary 


Like the situational calculus, Rosenschein's framework provides 
both a proof theory and Semantics for planning (andy as well; is 
forced to deal with explicit frame axioms). AS in the state-Space 
planners, search iS separated from theorem proving, which is hidden 
in auxiliary functions. The BDIGRESS algorithm provides a "hook" for 
adding search heuristicse The limitations of SIRIPS type operators 
are ahbandoneéde The general prozression and regression operators 


incorporate the model-updating operations of STRIPS and its progeny 


as Special caseSe Bidirectional search can otfer considerably 
better performance than unidirectional search (Nilsson SO). 
Sacerdoti's "hierarchy ot abstraction Spaces! is given a formal 
definition. Not only may actions be described in greater or lesser 


detail at the various levels, but entirely different actions nay 
appear, and the world may be described using different vocabulariese 
The exact hierarchy prevents unhappy claskes between subplans, as 


does the exact hierarchy obtained by the use of MACRCPS and BIGOPS. 


It must be admitted that some of the comparisons with earlier 
systens are not really fair: BIGRESS gains much of its venerality 
(as in it's handling all kinds of disjunctive and conjunctive goals 
and state descriptions) by avoiding some of the particular issues of 
efficiency which led to STRIPS. In any caSey the descriptive power 
of dynamic lowsic makes it a powerful tool for formally comparing and 


evaluating various flanning sStrategiese 


CRAPTER 3 


A FIRST-CRDER DYNAMIC LOGIC 


2-21 THE LANGUAGE 


There is no one first-order dynamic logic; ma ny logics have 
been defined which fall under this rubric [Harel 75]- The basic 
plans , or actions, with which workers in program verification are 
concerned relate worlds with ditfering interpretations of some 
functions [ieee program variables); we are instead most interested 
in actions which affect only the extensions of predicates (ecege, the 
truth value of on(BLOCKY9, TABLE) is changed by the action 
pickup(BLUCKQ9)). The rest of this chapter gives the syntax, 
semantics, and axionatics of a language I call TranSparent Dynanic 
Logic, desiyuned to express just such actions. The general outline 
follows [Harel 79], but the particular formulation of actions with 


parameters and transparency conditions is original. 
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Define the sets of Symbols: 
VAR=variables 
CON=constants 


PRED( j)=predicate symbols of arity j, for j=0O,1,2,.e. 
PRED(2) Includes at least t=", 


ACT(j)=action symbols of arity Jj, for j=O,1,y2,e0e 
Let TERMS=VAk u CON 
PRED=PRED(VO) u PRED(1) u eee 
ACT=ACT(0) u ACT(1) WU eee 
The well-formed tormulas and plans of TDL are defined by mutual 
recursicne* An atonic formula is an n-ary predicate symbol followed 
by n termse An atomic action is an n-ary action symbol followed by 


— ee es ee See 


1. An atomic action is a TDL-plan.e 


2e Where P is a non-modal TDL-wftf, and A,B are TDI-plans, then 
null, (A;B), (A U B), and P? are TDL-plans. 


aie An atomic formula is a TDL-wffe 


4. Where x € VAR, P,Q e€ TDL-wffsSs, and A € TDL-plans, then =P, 
(PvQ), E x Py, and <A>P are TDL-wffse 
A non-modal TDL-wtf is a TDL-wiit containing no tDL~-plane (Ieecy a 
formula of function-free first-order logic.) We make the fellowing 


abbreviations: 


* Note on typography: Mv" is or; Matt is ands i is not; tat is 
implies; N=" ig two-way implication; Ne" is member; Maat is set 
union; Ue is subset; tet js the existential quantitier, Wy is 


the universal yguantifiere 
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[A] for 7<A>x7 

¥x for ~E x- 

P aA Q for =P v -~Q 

P > OQ for =P v Q 

P= Q for (P > Q)al(C =P) 
t1#t2 for 7(t1=t2) 

true for pv ~p 

false for p A ™p 

(P -A,B) for ((P?3;A) U (>+P?;B)) 


The plan (P ~ A,B) corresponds to the more familiar programming 


language construct IF P THEN A ELSE Be 


A list of variables xlj,eees;xXn will often be abbreviated as Xy 
as in 
(E X) P for Exl Ex2 ee. Exn P 
In general, a capital letter standing in a place where a variable is 
expected will stand for a list of variables. Constants will always 


be capitalizede 


A particular dialect of TDL is specified by its vocabulary, 


<CON, PRED, ACT>e 


Se ee 


(i) B can be written as A1l;A2seee3An with at most one Ai not 
atomic; and 


(ii) Such an Ai is of the form (TEST ~ B1,B2), where TEST is a 
nonmodal wff and Bl and B2 are in normal form; and 


(iii) Put in prenex form, TEST's quantifiers are either all ¥ 
or all E. 


Unlike the propositional case, TEST cannot always be made atomice 


The need tor condition (iii) is discussed in section 44. 
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30e3 SEMANTICS 


A structure, or interpretation, of TDL is a triple <DOM, WD, m> 
where DOM is a domain, WD a set of worlds, and m is a function which 
interprets the action symbolse Each world interprets the terms as 
members of the domain, and the predicate symbols as predicates over 


the domaine In an acceptable transparent structure: 


1. The meaning of "=" is fixed as equality. 
2e Constants receive the same interpretations in all worldse 


Be For any world I, variable xy, and entity d;, W contains 
{d/x}) I, a world just like I except that x is interpreted as de 


4. Actions are tranSparent, as explained below. 


A meaning function M interprets a plan as a binary relationship 
over WD (ieee, a set of pairs of elements of WD), using m= to map 
action symbols to functions from entities to binary relations over 
WDe We define M and truth in a world I, written I|=, as follows. 

Pott sees, tn) iff I{p)(1(ti),..+, (tn) ) 
where I(p) is the interpretation of predicate 
Symbol p and I(ti) is the interpretation of 
term ti in world Ie 

ee ti=-t2 iff I(t)=1 (+2) 

m= =P iff not 1|=P 

Mier v Oniftf Ll=eP or b= 

I]= Ex P iff for some d € DOM, {(d/x)I|=P 

I|= <A>P iff for some J ¢€ WD; 


(I,J) e€ M(A) and J|=P 


WxW 
Define M: TDL-plans ~ 2 1 where 
J Wx W 
m: ACT(j) ~ (2 DOM ~~ 2 ) 
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as follows: 


M(a(tiyece,tn) ) = ((1,J) | 
(IyJ) € mlad(I( tl) »oooyf(tn))} 


M(mull) = ((1,1) | I e€ WD} 
M(A U B) = M(A) vu M(B) 
=({(E£,J) | (1,5) e€ MCA) or 
(IyJ) e€ M(B)} 


MOP?) = (C2, Biel tile 


4(A) o M(B) 
={(I,J) | Exist K e WD such that 
(I,K) e M(A) and (K,J) e€ M(B)} 


M(A;B) 


Condition (2) requires that 


I(C)=J(C), all I,J € WDy C € CON 


The null action simply takes any world to itself, while a test 
action P? is the identity relation restricted to worlds where P is 
truee One can derive semantics for the normal conditional form: 

M(P ~ Agb) = {((1,J) | 
Either I[=P and (I,J) e€ M(A) 
or I]J=7P and (1I,J3) e€ NM(B)} 
The definition of M for atomic actions indicates that 


parameters are evalutated in the initiai world. Condition (3) above 


insures that all quantified formulas can be interpreted. 


The transparency conditions on actions allow substitution of 
terms through modal contextSse For example, from 
¥x (box (x) >{ pickup(x) Jhold(x)) 
we'd like to conclude 
box(B1)>[ pickup(B1) Jnold(Bl1) 
but nothing so far assures that x has the same interpretation before 


and after pickup(x), and that the only input to pickup is its 
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parumeter. The requirement is: 


(£,5) € MCA) > I(t)=J(t), any term t, any 
atomic action A 


(I,J) € M(a(til,«s«-tn) ) 2 
({d/x)JL, (a4/x} J) € Mia(ti,ec.., tik) ) 
for any d e€ DCM, x € VAR, 


whenever x iS not one of tl yeooo, tk 


The result of all this is that only quantifiers will bind variables. 


Say S is a structure and P is a TDL-wftf. S satisfies P if P is 
true in every world in Se P is valid, written 
ee 


if every transparent structure satisfies P. Where G is a’ set of 


formulas (axioms), we write 


to mean that every transparent structure which satisfies all of G 


satisfies Pe 


3-4 AXIOMATICS 


The axions and rules of inference include aii those for 
function-free, first-order logic with equality and Loop-free dynamic 
logic. P and Q will stand for any TDL-wff, and A for any atomic 
action. "The tern t is a parameter of atomic action A" is 
abbreviated t € Ae The usual notions of bound and free occurences 
of a variabie hold. For example, x is free in the wff 

(drop(x)] onfloor(x) 
We write 
Pits x) 


for the formula obtained by substituting term t for all free 


Ags 
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occurences of x in formula P: 


Ale 


A2e 


AGe 


Ade 


ASe 


A6e 


A7e 


| ABe 


AQ. 


RL ty <)> x 
s(t/x} = s for any term s other than x 
pti, «se«,; tn) lt7 x) = p(tl (t/x}) ,ece,tn(t/x} ) 


(>P)(t/x) = ~(P(t/x} ) 
(P v Q)(t/x}) = (P{t/x}) v Q(t/x)}) 
(¥yP) (t/x} = ¥2((P ly/z)) (t/x)}) new variable z 
(La tl 52 ~« 05 tn) IP) 7x 
fal t1 (t/ x) pceoytn Ct/ xD P(t/x)} 


first order 


All tautologies of propoSitional calculus 
¥x(P > )) > °(¥eP [54x 7) 
¥xP > P(t/x} » for any term t 


P > ¥xP , where x is not free in P 


modal 


CA]}(P > Q) > (LAIP > [A]Q) 
[P?]O = (P > Q) 

(nulJ]P = P 

CA]( BJF = [A;BIP 


(A U B]P = [A)P a [B]P 


A105. ¥x[ AJP > [A]¥xF , if x # A 


All 


A12 


equality 


eo ¥x(x=x) 
. ti=t25 (pl ecezgtlygeece) = plecezst2zeee) ) 


all go e€ PRED 


A113. ¥xy(x=y > [A] x=y) 


A1l4e V¥xy(xfAy 2 [A] x#y) 


rules of inference 


30 
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Rl. From Py, P2Q conclude Q 
R2e From P conclude ¥xP 


R3e From P conclude [AJP 


The axiomatization is sound, where we take soundness to mean 
If GHP then G|=P 
The only non-standard axioms are AIC and our version of A3_ with 
substitutions allowed through atomic actions; the transparency 
conditions enforce the truth of these axiomse Al10O, the so-called 
Barcan formula of modal logic, also depends upon our definition of a 
structure as containing a single domaine A10 would not hold if we 
ever wished to model actions which actually create and destroy 


entitiese 


The axiomatization is complete in the sense that 
If G|=b then GtP 
Since we only give partial semantics for the atomic actions, we 
won't talk about completeness in terms of capturing all the true 
formulas in a particular structure. ({Harel 75] and (Pratt 76] 
demonstrate complete axiomatizations of loop-tree first-order 


dynamic logic where the only primitive actions are test and 


assignment. ) 


3-5 LEMMAS 


Some useful derived rules of inference are: 
DR1: From P2Q conclude ¥xP > ¥xQ 


DR2: at ExP > ExQ 
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DR3: " [A]? >epalyo 


DR4: WM <A>P > <A>Q 


The tollowing Simple theorems of TDL shall 


well. 


TH: If P is a TDL-wff and a valid formula of 
first-order logic with equality, then tP. 
Proof: Obvious, since TDL incorporates 


TH2: It Gt P2Q then GulPJt Q. 
Proof: ki applied to Gu({PJHP, Gu[{P)t P>Q. 


The reverse does not holde 


Lenma: t Ex{A]P > [A]JExP, tex €9 Ae 


Proot: 
le ¥x2P > ~P A3 
Qe ¥x<A>¥xAP = ¥x<A>—3P 1,DR4,DR1 
Be <A>¥x7P D> ¥x<A>¥x2P A4 
4e <A>¥x-2P D ¥x<AD~AP Op oy Ee 
Se Ex{A])P > [AJExP 4, PC 


TH3: t+ KLAJP > [A)KP 
where Kk iS a sequence of quantifiers, and 
none of the quantified variables appear in Ae 
Proof: Induction on the length of Ky 
using A1G and TH2-. 
This theorem allows us to "push" quantifiers 


through actionse 


THS: (LAIP A 1AJ9O) > (AE onc) 
TH6: (CAJP v [AJQ) > [A}(P v Q) 
Proof: These are true for any dynamic 


a Se ee Ee 


logic; see [Harel 79]. 


prove 


Page 


helpful 


CHAPTEK 4 


A FIRST-CRDEK FRAMEWORK 


We now szeneralize the propositional framework described in the 
chapter 2 to handle a subset of first-order planning problems. 
BIGRESS is extended to plan to satisfy multiple plan constraintse 
The notion of planning to satisfy multiple constraints is more 
#zeneral than that of planning to achieve multiple (conjunctive) 
@oals, and will prove useful in the later discussion of hierarchical 
planning. The progression and rezwression functions are discussed in 
detail. Finally, some comments are made on suitable control 


strategies tor the non-deterninistic BIGRESS algorithm. 


4.1 FORMULATION OF A PLANNING PROBLEM 


Since TDL incorporates first-order loyzic, it obviously not 
decidable. It is well-known, however, that the validity problem is 
decidable for first-order formulas which can be put in prenex torm 
Ke) that all univer sally-quantified variables preceed all 
existential ]ly-quantified ones [Ackermann 1954]. We restrict our 


attention to a class oi planning problems which can be solved using 


A FIRST-ORDER FRAMEWORK Page 34 


only first-order reasoning about formulas of this forme 


A prenex wff or set of wffs which in all ¥-quantitfiers appear 


betore all E-quantifiers is "¥-first"; the converse is "E-first". 


oe oe ee re ee ee ee ee 


1. VOC = <CON,PRED,ACT> is the vocabulary of the problem: the 
particular dialect of ‘TDL to be used in synthesizing a solutione 


The vocabulary (in particular, CON) is finite. 


Ze G is a set of axioms, the domain constraints. It contains: 


Gs, the static axioms y a finite set of E-first non~modal 


formulase 


Gd, the dynamic axioms, a finite set of formulas of the form: 
(¥ VY) Ce Set Z) leap 

Y is a List of variables and Z is a list of terms such that Y 

contains any variables in ZL SE p and qG are non-modal 

quanti fier-free formulas all of whose free variables are 


contained in Ye Where Z is of length j, a e€ ACT( Jj). 


Ge, a Special set of axioms of the forn 
ci # C2 


tor all Cl, C2 e€ CON, Ci not the same as C2. 


3-e RES(ul(ti)) is a set of k plan constraints, each of the form 

(¥ X)(r 2 CulH)] s) 
XxX is a list of variables and H a list of terms such that X contains 
any variables in H; r is a non-modal, E-first wif; s isa 


non-modal, ¥-first wff;5 and the free variables in rand os fall in 
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Xe The variables in H are called the problem parameters. 


A solution is a normal-tform plan B such that substituting 3B for 
u(H) in each plan constraint creates a theorem derivable trom G, and 
the only free variables in B are the problen parameters. H may be 


thought of as the "input" to the plan. 


For example, if RES(u(h)) is 

(¥ h)(block(h) 2fulh)) inbox(h)) 

(¥ h x) ((sinbox(x) an x#h) >Lulh) ] ainbox(x)) 
the constraint is to find a plan to put any block h into the box, 
without putting anything else into the box. The only input to the 


plan will be the particular block to he movede 


Constants are made pairwise disjoint mainly as a. matter of 
convenience; in the exanples which will be presented, free 
variables are used in place of non-unique constantse We are not 
assuming that there is a constant for every entity in the domain 
(unless, of course, GS specifically includes a domain closure 


axiom) e 


a Sw ee 


(¥ xy) (p 2fal(Z)] q) 
such that 


Ge (¥ Y)(p > q) 


A pure frame axiom is one of the form 


—— —— —— — 


(¥V ¥)Cp 2LalZ)]) p) 
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A predicate p e¢ PRED(Jj) is invariant in G if tor any a é 
ACT(k), lists of variables Y and Y', 

Ge (¥ Y Y*')C ply) = Lal¥") 7 ptxh) 

Ce (¥ ¥ Y®)( aplY) > LalY¥*)] -~plY)) 


holde Note that "=" ig invariante 


4.2 BIGKESS ALGORITHM 
We review and extend Rosenschein's bigressSion algorithme 


The function LW caiculates the strongest provable 
posStcondition of a condition and an action, "\" calculates the 
weakest provable precondition, and "Gt" takes as input a non-modal 
forrnula Py, and decides whether P is provable from Ge Where 
RES(u(H)) is tne set of wiffs 

( (¥ Xt)Cr1 > LulH)] st), eee » (¥ Xk) (rk > [ulH)] sk) } 
A is an atomic action, and TEST a wff,; define 


kR = (rlygeeesrk) 


S = (sl ,<se, sik) 

R/A = {rl/Azeeesrk/A} 

A\S = CA\SlyececzA\Sl1} 

k A TEST = (rl a TEST,eee;,Sk A TEST} 


An acceptable plan is returned by calling BIGRESS(R,S). Assume 


dynamic sco,z ing of R and S for recursive callS within PIGKRESS. 
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BIGRESS(k,S): 


If Gt ri >D gsi for i<=i<=k 
then return( null ). 


° 


Choose: 


Choose <A, R/AD> from Livetorward(F): 
return( A;BIGRESS( R/A, S ) )e 


Choose <A, ANS> from Livebackward(S): 
return( BIGRESS( Ry, A\S );A )- 


Choose TEST from NonTriv(R): 
return( TEST ~ SubPlani, SubPlan2 ) where 
SubPlani:= BIGRESS( R a TEST, S); 


SubPlan2:= BIGRESS( RK A ATEST, S).- 
ende 


Liveforwuord(R): 
emer at Las « cpiteidesn Rialtlinecesetj)> | 
a € ACT( Jj), ti e CON u H for 1<=i<=j, and 
for SOME ri € ky 
not GF ri Ss rif/a(tlyeceytij) J). 


Livebackward(i3): 
Petment( <alti,csceytj)y altisgeeestJ)\S> | 
a e€ ACT(Jj), ti e CON u H for 1<=i<=j, and 
for SOME si € Sy 
not GE altl,eceeytij)\si > si )) 


NonTriv(R): 
return({ TEST | IEST is a non-modal TDL-wtf; 
all free variables of TEST are in Hy 
TESI's quantifiers are either all ¥ or all Ey 
and for SOME ri e€ Ry 
not Ge fri > TEST 
not Gk ri 32 -3rEST }) 


Attenpting to choose fron an empty set is equivalent to 


failing. It may be desirable to impose further restrictions on 
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tests: for example, only allow predicates which directly corres);ond 
to the robot's sensory inputse Thus, NMhandenzpty" might bea 
legitimate test, but not "inside(BLK1,BOX2)" since BLkKI would be 


hidaen trom viewe 


4-3 CORRECTNESS ANT COMPLETENESS CF BIGRESS 


Define correctness and completeness of the implementations of 


the auxiliary functions "Gr", "/%, and "\" as follows: 


For any atomic action A, non-modal wffS Py ry gs: 
1. Correctness: 
a) If "Gtp" returns true then p follows from Ge 
b) Gt r 2 [A] r/A 


<) Ge A\s 2 [A] 5s 


2-« Completeness? 
a) It p follows from G then "Gtp" returns truee 
b) It Gtr r > [A] S then Gt r/A Dr? gs 


c) If Gre r > [A] Ss then Gt r >? AXs 


Definition: BIGRESS is correct if it only returns’ solutions; 
ieee, Tor any plan E returned by EIGRESS(R,S), 
Ge (¥ Xid(ri > [B) si) 


for each wri (¥ Xi)(ri > [ul(H)] si) e RES(ul(—H)), and the only free 


variables in B are in He 


The definition of the completeness of BIGRESS uses tne notions 
of an essential -solution to a planning problem, and of two solutions 


being essentially the same. 
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Definition: B is an essentiai solution to a planning problem 
if any normal-for®m plan Bt formed from B by deleting, any atomic 


actions, and/or replacing any conditional form (TEST ~ Bi,B2) by one 


of its branches Bl or B2 is not a solution. 


Definition: A plan B is essentially the same as a plan 8B if 


ees SS ee ee ee ee 
—< — = — 


B' can be obtained from B by inserting and/or deleting null actionse 


Definition: BIGRESS is complete if it can find a solution 
which is essentially the Same aS any normal-form solution B to a 


given planning probleme 


We prove the correctness and completeness ot BIGRESS relative 


to the correctness and completeness of "GE", "/"%, and "\'", Sections 


4.4 and 4-5 demonstrate the correctness of the suggested 
implementations of the auxiliary functions, and discuss some 
problems that arise in trying to obtain completeness. No actual 


proof of completeness is given. 


4.321 Correctness Cf BIGRESS 


Theorem: Given the correctness of "GF", "/", and "\" (1(a)-(e) 


ee ee 


above), BIGRESS is correct. Proof: 


Let B be a plan returned by BIGRESS(R,S)- Its length |B| is 
the number of non-null tests and actions in Be Attach the phrase 


“for all i, 1<=i<=k" after each tormula involving ri or Si in the 


following. 
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[If {Bl =0, then H=nulle The stopping test must have succeeded 
on the first call to BIGRESS, so 
CE Sri > sa 
By AT, 
Gr ri > ({nulljsi 
Otherwise Suppose that BIGRESS is correct for pians Shorter 
than |B|. On the first call to BIGRESS, the algorithm must have 


chosen one of: 


(i) <A, 


BIGRESS(R/A,S) 


k/A> from Livetorward(R). 
returns a plan B! 


such that 


1. ri/A > [B* Jsi induction hypo. 
26 {AJri/A > [AIL B'Jsi 1,DR3 
ais ri > [AJri/A "7/7" correctness 
Ge rio {A;B* Jsi 273;A8 


and H=A;B*%. 


(ii) <A, A\S> from Livevackward(S). 
BIGRESS(A\S,S) returns B® such that 
1. ri > [B']JA\si inde hypoe 
Ze A\sai >? [A]si "\'" correctness 
Be {bt JA\si 2 CB'J(A]si 27DR3 
4e ie [B';A)si 1,3,A8 
and B=B"' 5A. 
(iii) TEST from NonTriv(R). 
Then 
1. (ri a TEST)>[SubPlaniJsi inde hypoe 
Ze (ri A ~ATEST)>(SubPlan2]si inde hypoe 
3. rir((TESTS[SubPlanl]si) a 
(~»TEST>( SubPlan2Jsi)) hy2,PC 
Ae rir((TEST?;SubPlanijJsi a 
(~TEST?;SubPlan2Jsi) 3,A6 
or ri 2{ TEST? ;subPlanl U -aTEST?;SubPlan2]jsi 
4,A9 
That is, rir {BJsi where B=TEST~SubPlani1,SubPlilan2 


So in any case, B is a plan such that 


Gt ri > [BJsi 
By R3, 
Ge (¥ Xi)(ri > [B]si) 


Therefore B is a solution to the planning problem 
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OCG r (IY Xt0(ri > [ulH}) st), ss« , 
(¥ XK)(rk > [ul H))] sk) } > 
so BIGRESS is correct. 
4.3.2 Completeness Of BIGRESS 
Theorem: Given correctness and completeness of "GEM, "/", and 


"\", BIGRESS is complete. Proof: 


Let B he an essential solution to the planning problen 


<VOC, Go ( (¥ X1) (rl 2 {u(H)) sl), eee 7 


(¥ Xk) (rk > Cul)) sk) } > 
We show that BIGRESS(R,S) can return a plan essentially the same as 
Be Again, append "for all i, 1<=i<=k" after each furmula belowe 
First, note that if 
GF (¥ Xi)d(ri > [B]si) 
then by A3 
Saari > {B) si 
ve jes | =Oge then “Benwi 1; so Grri >(nullJjsi. By A7; 
Ge ri > si 
which is precisely the stopping test in BIGRESS: So null is 
returned. 
So assume completeness hulds for plans Shorter than Be Where 


B',B1,B2 are plans, A an atomic action, and TEST a non-modal wtf all 
of whose quantifiers are E or ¥, B is of one of the torms: 


(i) B=.43 bh! 
Ly <A& 
Gt ri > (A)J(B* Jsi 
and by "/"' completeness 
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Ge ri/A > [B* Jsi 
Suppose <A, R/A> was not in Liveforward(R).- Then 

Ge ri > ri/A 
which implies 

Gt ri > [Bt Jsi 
This would mean that B* is a solution to the planning 
problem; so B would not be an essential solutione 
Therefore, BIGRESS can choose <A, R/A>e 
By the induction hypothesis, the recursive call 
BIGRESS(R/A,S) can return a plan B** which is 
essentially the same as B'e Then the first call to 
BIGRESS returns A;B'', which is essentially the same 
as Be 


(ii) B= B';A 
From 
Gr ri 2 (B'J({A]si 
proceed to deduce 


Ge ri/B!' > [A]si "7/7" completeness 
Gt ri/B' > A \si "\'" completeness 
Ge [B' Jri/B' 3 [Bt jJA\si DR 

Ge ri > [B')ri/B* "/" correctness 


Therefore 

Gre ri > ([B' JA\si 
As before, it must not the case that 

Gre A\si > si 
for then B® would be a solutione BIGRESS can choose ~ 
<A; A\S> from Livebackward; by the induction hypothesis, 
the call BIGRESS(R,A4\S) can return B'* essentially the 
same as B*'; and BIGRESS(R,S) returns B'*;A essentially 
the same as Be 


(iii) B= (TEST~> B1,8B2) 
Given that 

GF ri M~[ TEST E1,B2)si 
A6; AQ, and propositional manipulations let us conclude 

Ge (ri a TEST) > [BiJ]si 

Ge (ri a -aTEST) > (B2]si 
Suppose TEST were not in Nontriv(R).- Then 

GF ri 2 TEST or Ge ri 2 aTEST 
But in the first case, (ri a TEST) = ri; so 

Gr ri 2[BL)si 
~-ieer,sy Bl would be a solutione Similarly, in the 
second casey B2 would be a solutione So TEST must be 
in Nontriv(R). 

Finally; BIGRESS(RATEST,S) can return Bi' essentially 
the same as Bl, EBIGRESS(RA-mIEST,;S) can return B2! 
essentially the same as B2; so BIGRESS(R,S) can 
return (TEST> EB1',B2') essentially the same as B.e 

Note that for some particular rh in RR, it may be the 
case that Gr rh 3 -=TEST; so rh aA TEST is falsee So some of 
the wffs in R on a recursive call to BIGRESS may be 
false. Any plan will then satisfy that component of 
the constrainte 
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(iv) si 8. 
The plan A is essentially the same as A;nulle By 
Case (ij, SICRESS Gan Wind «phen essentially the same 
as A;null and thus essentially the same as Ae 
In any casey BIGRESS can return a plan essentially the same as 


Be By the above definition, BIGRESS is complete; relative to the 


cumpleteness of "GEM, "/", and "\U, 


40903 Partial And Tctal Correctness 


Discussions of the correctness of programs distinguish the 
notions of partial and total correctness. The plan constraints and 
dynamic axioms we have used have all been in the form of partial 
correctness assertions: 

me >/ 8), s 
S will hold in any state reached by executing, B in a state where r 
holdse In particular, the assertion is true if no state is 


reachable by 3B from one where r holdSe 


What is desired, however, are plans which are totally correct: 


on aoe eee 


executing B in a state where r holds takes one to a state where s 


holds; that is, partial correctness plus guaranteed termination of 
Be [Rosenschein 81) remarks that termination of a plan (program) B 


is asserted by 
J= <B> true 


From any state, executing B can take you to some statee 


Although this definition happens to suffice for nornali-form 
plans, it is not always adequatee {Karel 79] points out that the 


meaning of termination depends upon the intended method of plan 
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execution. For a simple sequential regime, it is required that 
execution paths throuveh bB terninatee For instance, when 
B= (null;false?) U (null;true?) 
then 
<B> true 
but the execution path through the tirst half of the union reaches a 


dead-end at the false? teste 


The restriction of ?® and U to the if-then-else form ensures 
that whenever a test fails, a non-failure alternative (i-eee, the one 
headed by the nevation of the test) is immediately available. Thus, 
dead-ends can arise ina normal form plan only if it contains some 


atomic action which fails to terminate. 


So; we require that any atomic action, instantiated with 
whatever parameters, always leads to at least one state. 
Semantically, 

¥ ae ACT(J) 
¥ AdLlyeovegd J € DOM 
¥ Ie WD 
E J e€ WD such that (I,J) € mla)(dlyece ydj) 
The axioms are augmented by: 
A15~e <A> true , any atomic action A 


A Simple inductive argument then shows that -<B>true for any normal 


form plan Be 
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4.4 THE PRUVASILITY TFS? 


"CE" cun be leplemented by a complete tirst-order theorem 
prover if the non~inodalt AXLOMS Gs and Ge, are strony enough to 
derive all non-modal tormulas derivable from G. When this is the 
case, tests of the form 

Gt P » P non-modal 
ure equivalent to tests of the form 

t (Gs a Ge) > P 
When P is ¥-first and Gs E-first, the expression above is ¥-firste 
The decidatilty of this form is apparent in light of Skolem's 
theoreme The formula is valia peacsy My the skolem forn: ot its 
negution, is inconsistent. iM can contain only nullary function 
Symbols; thus, the Herbrand universe for M will be finite. All 
ground instances of M over this universe can be generatcuUu and tested 


for inconsistencye 


Care was taken in BIGRESS to ensure that the provability test 
was only applied to ¥-first formulas. Tests were restricted to 


E-only or ¥-only forms so that both TEST and ATEST would be ¥-first. 


Rosensc hein dismisses as Npoathological" cases in the 
propositional framework where non-modal theorems are derivable trom 
G but not GSe His example is the dynamic axion 

p > {a)false 


which togetber with <a>true (A115) allows one to conclude ~pe 


The prublem seems more tangible in the first-order frameworke 
Say the dynamic axioms include: 


¥ y (ply) > Ca] qly)) 
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¥y (rly) > Laj -~qly)) 


With AIS we can derive ¥ ylply) >? =arly)). 


In the propositional case and many instances of the first-order 
case, it is possible to mechanize the process for tinding axions 
which need to be added to GSe Look for inconsistent sets of dynamic 
axiom consequences, and add ass a new axiom the negation of the 


conjunction of the corresponding antecedents. 


It is not always possible, however, in the tirst-order 
framework, to make Gs as strong as G with respect to non-modal 
theoreiase The first example in section 5.2 gives a case where the 


dynanic axioms force the domain to be infinite but such a condition 


cannot be specified by a finite number of E-first non-modal axiomse 


In brief: the implementation of "GFE" that uses only Gs and Ge 
is correct (as defined in 4-3-2), but in some cases not complete. 
The progression and regression algorithms also assume that the 
non-modal axioms suffice to prove non~modal formulas, and similarly 


are correct but not necessarily completee 


4.5 PROGRESSION AND REGRESSION 


The trogression and regression funetione xeneralize the 
propositional functions outlined in section 244e7-« Recall that the 
progression ot a state description through an action was computed by 
finding all the combinations of antecedents of the dynamic axioms 
which were implied by the description, and taking the conjunction of 


the corresponding dynamic axiom consequencese In the first-order 
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case, a Single dynamic axiom may have a number of instances which 


are relevant to computing the progression: for example, 
¥y(ply) rxlalqly) ) has instances p(C) »La]Jql(c) and (¥x 
p(x))>[La](¥x q(x))-. The technique of resolution with answer 


extraction [Green 1969b] is used to find all relevant instances of 


the axioms. Formulas containing free and and bound variables, as 


well as constant terms can be progressed and regressed. 


Section 4.5.1 and 4-5-2 outlines the progression and regression 
alyorithms respectively; numerous examples follow. Proofs of 
correctness appear in 4.524. The‘ algorithm, unfortunately, is not 
gVvuaranteed to always terminate (although it does for the examples in 
this thesis); 4-5-4 contains a discussion of problems that can 


arise. No proof of the completeness of the alworithm is attemptede 


4.5el Prowression 


The propwression of a state description D through an atomic 


action a(Z) using domain constraints G is calculated in four steps: 


1. Form G(a(Z)), the set of the instances’ of the 
dynamic axioms for action a with parameter list zZ- 


De Put the description D in skolem forme Use the 
antecedents of the wffs in Gla(Z)) to construct an 
existential query on the skolem form of D; GS; and Gee 


3e Generate and conjoin all answers to the querye 


4. Transform the conjunction of answers by replacing 
each answer-wff by a corresponding instance of a dynamic 
axioin consequencee Replace skolem-functions introduced in 
step 2 hy bound variables. 
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The four steps are now described in detail.* 


First, check whether D is 


inconsistente 


postcondition is sinrnply talsee Otherwise, 


Collect all the dynaric axioms 
including instances of schema Al15 
variables aparte Rewrite the axionisS, 
antecedent of each dynamic axiom is 
the conseyuence is a dis junction of 
sinyzle axiom 

¥Y¥((epily) v p2ly)) > Cal¥)) (qil¥) 
can be rewritten as four axioms 


¥Y (pl(Y) 2 Cal(¥)] qllY)) 


U 


VY (p2(Y) Ca(Y¥)J] gilY)) 
¥Y (pl(Y) > LalY¥)J] q2(Y)) 


¥VY (p2(Y) 


U 


Cal¥)J] q2(Y)) 


Also rewrite tne axioms, if necessary 


conta 


and A16, 


if 


Page 4&8 


Lf SO, the 


proceed as follows: 


ining 


action symbol ay 


and rename all bound 


neceSSary 3 so that the 


a conjunction of literals, and 


literalse 


a q2(Y))) 


For example, the 


» to assure that all parameters 


of a in each axiom are distinct bound variablese 


p> Latlel) }] gq 
is equivalent to 


¥y((p a y=C1) > [Laly)] q) 


a cam ee cee ee ee ee ee ee ee ee ee es 


*Notation: Capital letters (such as Z) are used tor 


For example, 


terms, and small letters for matrices of formulase Sy p(x) 


a quantifier-free non-modal fLornula 


whose 


iree 


variables 


lists of 


we mean 
are a 


subset of X; by p(T), we mean a formula of the same form with terms 


T substituted for Xe 
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Form G(a(Z)), the Z-instance of a, by substituting Z for the 
corresponding parameters in each axiome Let F be the free variables 
which appear in D or Z (leees the plan parameters and; as described 
in chapter 7 the formal cbhjects). Gla(Z)) is a set ot j formulas of 
the form 

(WYi) (pilYi,F) > La(Z)] qilYi,F)) * 


(We may 9 at this point, throw out those axioms which have 


inconsistent antecendents,; tor example, when the substitution 


instance of the above axion is 
Woman c2-Cl) > [al{c2)]) aq 
The more weneral form is required when the parameters, zy include 


free variables.) 


Step 2: Form Query 


Dis t-first, and G is eyguivalent to an E-first formula, the 


conjunction of all the static axiomSe So Say 


D = (E Xb) (¥ Yb) d(Xb,Yb;F) 
Gs= (E Xe)l(¥ Ye) e(X2,Yze) 
A query is an E~quantified non-modal formulae An answer is a 
disjunction of variants of the query (formulas like the query with 


different terms substituted for the E-quantified variables), which 
is a consequence ot the axiomSe We wish to tind the "strongest" 


answer to the query 


* That is, the free variables in the antecedent and consequence of 
the wff are a subset of Yi u Fe 
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Ge D > (CE YI)p1(Y1,F) v 
(E ¥2)p2(Y2,F) v 
r e eo v r 
(E YJ) pulYJj,F)) 
--an answer from which all other possible answers can be derivede 
Intuitively, we want to know all the ways in which the initial world 


description together with the non-modal axioms Satisfy the action 


preconditionse 


Our method is to generate and con join all answers to the query 
t ((¥ Yo) d(XbyYb,F) an (¥ YelelXerYe) ” Ge) 32 
(E YG pil YJjrF)) 


Note that U-quantifiers in the antecedent have been droppede We are 


assuming that the dynamic axioms are not needed to answer the querye 


Resolution proceeds as followse The free variables in Xb, XB 
and F ere converted to O-ary skolem functions Xb', Xe', and F*. The 
base clauses will consist of the skolema forms of the initial world 
description, the static axions, and Ge, the axioms for inequality 
between different constants. 

base clauses: 
d(Xb',Yb,F*) 
e(Xe', Ye) 

Ge 
The query is negated and skolemized, using the same skolem tunctions 
for the tree variable in F as beroree Each api(Yi,F') falls ina 
separate clauSsee Following [Green 6%b], Special "answer" predicates 
are attached to each query clause to trace the substitutions made 


for each variable in each Yie The base clauses are augmented by: 
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query clauses: 
sap1l(Y1,F"') v ansi(yYil) 


~p2(Y2,F") v ans2(Y2) 


apgjl(YjesF"') vi ansjl(Y J) 


The standard resolution rules can be strengthened with rules 
for eguality, such as paramodulation (described in [Chang 73]), so 


that explicit substitution axioms for equality (instances of schema 


A12) need not appeare 


Create a breadth-first tree of all resolutions, without ever 
resolving or paramodulating directly ayainst an "ans" literal. Each 


answer clause is a deduced clause containing only ans literals: a 


disjunction of variants of some of the ansi(Yi)'s. In each variant, 


some list of constants, skolem functions, and variables replaces 


each Yie 


Resolution continues until no Significant new clauses can be 
created, or (perhaps) some pre-eStablished time limit is reached. 
(Section 4.5.3 discusses some conditions under which resoiution does 


not naturally terminate. ) 


A double-subscripted "anshl(Thl')" is the 1-th variant 
appearing in the bh-th answere Thy ist is the particular variant 
creating, substitution, and n(h) is the number of of literals which 
appear in that answere For instance, the Second answer is 


ans21(T21") v ans22(T22') v eee v ans2n(2)(T2n(2)'") 
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bifferent variants cf the same ansi may appear in an answer Clauses 
Form the conjunction of all m answers: 
(ansi1(TL1"') vioeoe v ansiln(i1)(Tin(1)!)) 


RNR eee A 
(ansmi(Tmt") voeee v ansmn(m) (Tmn(m)!) ) 


Corresponding to each variant anshl(Thil') is a dynamic axion 
instance Phl(Thl',F") > ghl(Thli',F*"). Substitute tor each 
anshl(Thl1') in the conjunction ot all answer clauses the 
corresponding qhl(Thl',F*t). 

(q11(T11"',F") vi eee v qin(1)(Tin(1)',F*) 
AN eco A 
(qm1(Tmt',Ft) veces v qmn(m) (Tmn(m)',F*) * 

Let U wne the list of all variables which appear ain any (ORS 
Let Thl be obtained trem Thi" by replacing terms from Xb‘, Kg", or 
F' by the original variables from Xb, XB or Fe The strongest 
provable postcondition is then 

(E Xb) (E Xg)(¥ U) 
( (gG110T11,F) v eoe v ginl(l1)(Tin(1),F)) 


A eee A 
(qnul(Tm1,F) v eee v qmn(m)(Tmn(m),F)) ) 


4-5-2 Revression 


The outline of the regression algorithm mirrors the progressive 
CASE e The task is to find the instances of the dynamic axioms whose 
conseguences imply the state descriptione The existential query 


forned by the algorithm is the contrapositive ot this implication: 


cee mee ene eee ee ee ee eee ee ee 


x Formulas of the above form are abbreviated as 
(qi1l(T11',F") va etc) in the following sections. 
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it asks for the disjunction of negated dynamic axiom consequences 
which are implied by the negation of the state description. 


Step 1: Form G(a(Z)) 


Gather the axioms for a and torm the Z-instance of a as beforee 


fur 
es 
ie 
Ic 
i) 
lee 


Form Query 


Let D be the ¥-first goal world description ana a(Z2) the 


action. Where F is the list of tree variables in D and Z, 


D (¥ YD)(E Xb) d(Xb,Yb,F) 


Gs= (E Xe) (¥ Ye) alXe:Ye) 
The general form of the existential query is: 
Ge -=bD > ((E Yi)arqi(Y1l,F) v 
(E Y2)ng2(Y2,F) v 
e e eo V 
(E YJjJ)aqJjl(Y¥Jj1F)) 
F", Yb', and Xg' are lists of skolem functions corresponding to 
variables Fy, Yb, Xee Resolve the clause set: 
base clauses: 
ad(Xb,Yb',F*' ) 


elXe',sY¥ag) 


Ge 


A FIRST-ORDER FRAMEWORK Paze o4 


query clauses: 


qil(Y1,F") v ansil(Y1) 


GJI(Yd1F") vi ansJj(YJ) 


oe ee ee oe ee on en ee 


[f an empty answer arises then it must be the case that GFB y 
and the complete precondition is simply truee Otherwise, torm the 
nevation of the conjunction of all the answers (with the same 
assumption that only a tinite number will be wenerated). 

a((ansil(T11"') vieee v ansin(1)(Tin(1))) 

A eee A 


(ansmil(Tm1') vioeee v ansmn(m) (Tmn(m))) ) 


Answer Formula 


Replace each variant anshl(Thl* ) by the corresponding 
saphl(Thi',F*) and simplifye 
(pl1(Tiit',F®) a eee a pin(l) (Tin(1)"',F*) 
V eee Vv 
(pul€Tmal',F*) N eve A pan(m)(Tmn(m)',F*) 
Let U he the List of all variaties in any Thl'; replace the Skolem 
functions in each Thl' by the original variables from Yh; Xg;y and Fe 
The weakest provable precondition is then the ais junction of 
conjunctions, 
(¥ Yb)(¥ Xe)(E U) 
((pli(Ti1,F) a ece A pin(i) (Tin(1),F)) 
Vv ose V 
(qal(Tml,F) A eee A prn(m) (Tan(m),F))) 


henceforth abbreviated (pit (T11,F) av etc). The precondition, like 


the orignal goal state, is ¥-first. 
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4.5.3 Exanples Of Progression And Reeression 


For clarity of exposition of the following examples, I assume 
that the answer generator is sophisticated enough not to produce 


redundant answerSe 


Recall the propositional example from [ Rosenschein Sil, which 
uses the tollowing axiomSe 


Gd 
A [a] (BvC) 
G 2{a] -=B 
(FAE) 2Caj D 


In this case Gla) is simply the same as Gde 


Ex 1: Calculate AAG/a 


base clauses 


query clauses 
“A v ansl 
-"G v ans2 
=F v 7~E v ans3 


answer clauses 
ansi 
ans2 


postcondition 
(Bv CC) AaB = C 


Ex 2: Calculate a\(CvD) 


base clauses 
aC 
aD 


query clauses 
Bvcv ansil 
"3B v ans2 
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Pv ans3 
answer clauses 
ansi v ans2 


ans3 


precondition 
(A a G) v (F A LE) 


We see how v and A are reversed when forming the preconditione 


a ee eee Sone Se ee ee ee ee Se 


The next series of examples come from the delighttrul world of 
electronic warfare. Interpret mx(CI1TY) and hq(CITY) as CITY is the 
location of an mx missile silo and CITY is a command headquarters 
respectively. Bombing a city destroys any missile silo there, but 
all other silos are unaffected. 

Gd 

(1) Vy (nxly) > Lbomb(y)] >amx(y)) 

(2) Vyz ((rmxlz) a y#z) > [bhomb(y)] mx(z)) 

pure ftrame axioms: 

(3) ¥Wyz (-~mx(z) 
(4) ¥yz ( hqlz) 
(5) Vyz (ahq(z) 


(6) ¥yzw( z=w 
(7) V¥yzu( z#w 


Cbomb(y)] >~mx({(z)) 
[pbomb(y)] hq(z)) 
[bomb(y)] =hg(z)) 
[bomb(y) ] z=w) 
Lbomb(y)] z#w) 


UUU UY 


Ex 3: Calculate Ex(mx(x) a hg(x) aA mx(MLAMI))/bomb(MIAML) 


The set of formulas G(bonb(MIANMI)) is formed by substituting MIAMI 
for y in each of the dynamic axioms. 


G(bomb(MIANI) ) 


mx( MIAMI) > [bomb(MIAMI)] ->mx( MIAMI) 
Wz ((mx(z) A MIEAMI#4z) > [bomb(MIAMI)] mx(z)) 
¥ zz (-amx(z) > [bomb( MIAMI) ] ->mx(z)) 
¥z ( hq(z) > [bomb(NIAML) J hq(z)) 
¥oz (>hnq(z) > [bomb(MIAMI)] -amhg(z)) 
¥ zw ( z=w > [bomb(MIAMI)] z=w) 
¥ zw ( z#w > [bomb(MIAMI)] z#w) 
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The general form of the query is 


te (mx(x) a hol x) A mx(MIAMI)) > 
mx(MIAMI) v 
Ez(mx(z) a z#AMIAMI) v 
Ez(-mx(z)) v 
Ez(hq(z)) v 
Ez(-hq(z)) v 
Ezw(z=w) v 
Ezw(z#w) 


Rewriting this in clausal form: 


base clauses 
mx (X) 
hq(X) 
mx (MIANI) 


query clauses 

amx(MIAMI) v ansl 

amx(z) v z=M1LANI v ans2(z) 
mx(z) v ans3(z) 

sahq(z) v ans4(z) 

hq(z) v ans5(z) 

z#wv ans6(z,w) 

Z=w v ans7(zyw) 


xX is a skoiem function replacing the existentially quantified 
variable x in the world descriptione The (pruned) answer set 
contains 


answer clauses 
ansl 
ans2(X) v ans6(X,MIAMNI) 
ans4(xX) 


This corresponds to the valid formula 


(Ex(mx(x) A hq(x) a mx(MIAMI))) 3 
Ex(mx(MIAMI) a 
((mx(x) A x#MIANI) v x=MIANI) A 
hq(x)) 


which yields 


postcondition 
Ex(amx(MIANI) a 
(mx(x) v x=MIAMI) A 
hq(x)) 
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Almost any action can aiter existentially-yuantified intormatione 
Before, we knew that something was both a headquarters and a missile 
silo; atterwards, the second condition may have been invalidatede 


The postcondition is equivalent to ~amx(MIAMI) a Ex(hq(x)). 


Ex 42 Calculate bomb( NYC) \¥x(-—~mx(x)) 


base clauses 
mx (X) 


query clauses 
amx (NYC) v ansi 
mx(z) v ans2(z) 
amx(z) v ans3(z) 
hqa(z) v ans4(z) 
ang(z) v ensSlz) 
Z=w v ans6(2z,w) 
z#w v ans7(zyw) 


answer clauses 
ansi v ans6(X,NYC) 
ans3(X) 
precondition 
¥x((inx (NYC) A x=NYC) vo ammx(x)) 
That is, ¥x(mx(x) > x=NYC), which agrees with our intuitions: if no 


Silos are left after bombing NYC, beforehand NYC could have been the 


only Siloe 


Ex 5:3 hit (NYC)\Ex(amx(x«) ) 
base clauses 
mx (x) 


query clauses 
same aS previous example 


answer clauses 
ansl 


ans3(x) 


precondition 
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Ex(mx (NYC) v -wmx(x)) = true 
An important part of any implementation wild ciearly be a 
sim: Lification mechanisme The cost ot reqressing 


Ex(mx(NYC v -amx(x)) through further actions would be many times’ the 


cost of siwjply rewressing true. 


—— = —— ee ee 


A single dynamic axium can represent an action which atrects an 
arbitrarily large pumnbhver of entities. Consider an action which 


bombs all cities where headquarters are located. 


Gd 
(1) ¥y (thqly) > [bomballhq] ~mxty)) 


frame axioms 


(2) ¥z ((mx(z) 
(3) ¥z (~mx(z) 
(4) ¥z ( hKqlz) 
(S) ¥z (rhq(z) 
(6) ¥zw( z=w 
(7) ¥zvu( z#w 


sahg(z)) > [bomballhq]) mx(z)) 
{bombalillhq] 7mx(z)) 
[bomballhgq] nglz)) 
{bomballhg] ahq(z)) 
[bomhbalihg] z=w) 

{bomballhg] z#w) 


U UU U 'U > 


Ex 6: Calculate (hyg(LA) a hg( BUF) )/bombalihy 


hbase clauses 
hq (LA) 
hq (BUF ) 


query clauses 
sahqly) v anstily) 
amx(z) v ans2(z) 
mx(z) v ans3(z) 
sahq(z) v ans4(z) 
hq(z) v ansS(z) 
z#w v anst(zy,w) 
Zz=w v ans7(z;w) 


answer clauses 
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ans1(LA) 

ansi1(BUF) 

ans4(LA) 

ans4(BUF) 

ansl(w) v ans5(w) 

postcondition 

¥w (amx(LA) A amx(BUF) A 
hq(LA) a haq(BUF) a 
(ahq(w) v amx(w))) 


The postcondition simplifies to 


¥w (hq(w) > -agxx(w)) A hq(LA) A hq(BUF) 


A final example demonstrates the step in which axioms with 
disjunctive preconditions or conjunctive postconditions are 
rewritten as sets of axioms. Say G contains 

¥xy (plxey) > Ca] (glx) a tly))) 
Rewrite this in Gla) as 
¥ xl yl (p(x1,y1) > Ca] q(x1)) 
¥ x2 y2 (p(x2;y2) > fa] tlx2)) 
Cne may confirm that 
a\(q(C) a t(D)) = (E x2 yi) (plC,yl) a p(x2,D)) 


which is a precondition weaker than the more obvious p(C,D). 


4265-4 Correctness Cf Progression And Regression 


We demonstrate the correctness oft the progression and 


regression algorithms described in 4¢5e1 and 4-542. 
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a es | Correctness Of Progression - 


We show that the implementation of "/" is correct: that 


GE b> [alZ)] Dsa(Z).- 


The uescriptive formula D can become false when conditionals 
are introduced in the presence of multiple constraints. Since 
- @alse > [al(Z)] p 
t false > [a(Z)] ap 


then talse/a(Z) >» ftalse. 


Axioms AJ and A4 and rule R2 allow renaming of bound variables 
in modal formula , as well as the Substitution of particular terms 
for pareanweters when Ga is formede The correctness demonstration 
proceeds in two stazese First, we show that 

CF D> (EL Xb)CE Xz) (¥ U)CpLI(T11,F) va etc) 
Second, that 


GE (E Xb) (E Xe) (¥ U) (pili (T11,¥) va etc) > 
{a(Z)] (F Xb) (E Xg)(¥ U) (gil(t1l1,F) va etc) 


Modus ponens completes the proofe 


Lemma 1: GF Db > (E Xu) CF Xe) (¥ U) (plii(Tit,F) va etc) 
We know that the use of tracim functions 1S a correct ine thod 

for inmplernenting answer extractione Therefore the formulas 
phi(Th1",F') vi eee v phn(b) (Thn(h)'sF") 

are deducil:ite trom the bases clauses for 1<=h<=nie By the deauction 

principle ut first-order logic, 


((¥ YbYe) (a(Xb",Yb,F') a alre'sYe) “« Gel) > 
(¥ U) (pnl(Thi't,F') vi eee v phu(h)(Thn(h)',F')) 


is a tautology for 1<=h<=me Therefore 
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((¥ YboY¥e) (d(Xb"',Yb,F!') a «(Xe',Yg) a Ge)) > 
(¥ U) (p11(T11',F') va etc) 
is valide One can substitute a free variable for a O-ary function 
in a tautology and still have a tautologye So the skKolem functions 
can be eliminated: 


((¥ YboY¥g)(d(XbD,Yb,F) a g(XesYe) A Ge)) 23> 
(¥ U)(pl1(T11,F) va etc) 


Since this is a valid formula ot first-order logic expressible in 
TDL, Tlll tells us that this is a theorem of TDL. Simple first-order 
manipulations further transform the formulae 


t+ ((E XbXe)(¥ Y¥bYeg)(d(Xb,Yb,F) A @(Xe,Ye) A Ge)) > 
(E XbXz)(¥ U)(p11(7T11,F) va etc) 


t ((E Xe) (¥ Ye)alXerYe) a Ge) > 
(((E Xb) (¥ Yb)d(Xb,Yb,F)) 3 
(E XpbXg)(¥ U)(pl11(T11,F) va etc)) 

that is 

t (Gs a Ge) > (DB > (E XbXg)(¥ U)(p11(T11,F) va etc)) 

Ge D > (FE XpbXg)(¥ U) (pii(T11,F) va etc) 
Lemma 2: Ge (E Xb) (E Xe) (¥ U) (piil(T11,F) va etc) 2 

(a(Z)] (E Xb) (E Xe) (¥ U)(q11(T11,F) va etc) 
The second part is also straightforward. By A3 derive from Gd 


the series of formulas 


GF pl1(T1ii,F) > [{al(Z)] qi1(T11,F) 


GF pmn(m) (Tmn(m),F) > Cal(Z)J] gqmn(m) (Tmn(m) ;F) 
Propositional manipulations combine the abovee 


Ge (p11l(T11,F) va etc) o> 
(({fa(Z)Jqi11(T11,F) vi eos v [al(Z) Jqin(1) (Tin(1),F)) 


AN eae A 
({al(Z) Jqmi(Tm1,;F) v eee v [alZ) ]qmn(m)(Tmn(m),F))) 
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TUS and THE permit simplitication oi the consequence. 


GF (pli(T11,F) va etc) 3a Ca(Z)}](g11(T11,F) va etc) 


Insert quantifiers using DRI and DR2. 


GF ((F XbDXe)(¥ U)(o11(T11,F) va etc)) >a 
(E XbXg)(¥ U)CalZ))(g11(T11,F) wa etc) 


TH4 lets us push the quantitiers through the action. 
GE (CE ADXg)(¥ U)(p11(T11,F) va etc)) > 
[a(Z)] (E XpbXe)(¥ U) (glt(T11,F va etc) 
The final result is that the calculated postcondition 
indeed hold after the action: 
Ge D> falZ))] (E Xb)(FE Xe) (E U) (q1i(111,F) va etc) 


The alyvorithm is correct. 


We 5e 4s 2 Correctness Cf kepressSion - 


The steps are now 
Ge ((¥ Yhoxe) (E U)(gil(T11,F) av etc)) > D 
and 


Ck ((¥ YDXv) CE U) (pti(T11,F) av etc)) o> 
fa(z)) (¥ YbxXe)(F U)(GIil(T11,F) av etc) 


From the argument made earlier tor the correctness of 
extraction and the removal ot skolem functions, 


te (¥ XH) C¥ Yell(ad(Xb,Yb,F) an =e: (Xe1Ye2) A Ge) 3 
(¥ U) ((-gl1(T11,F) vi eco v ~wgin(i)(Tin(1),F)) 
RN eoe A 
(->qial(Tml,yF) vi eee v ~qmn(m) (Tmn(m),F)))) 


hence 


Pe ((E Xe) (¥ YedlelXe7Yea) an Ge) 32 
(((E Yb) (¥ xb)rd(XbL,ykb,F)) > 
(E Ybxe)(¥ ©) (-2g1ii(T11,F) va etc)) 


does 


answer 
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t (Gs A Ge) ps 
(((¥ YbXg) (E U)(q1i1(111) av etc)) > 
(¥ Yo) (E Xb)d(Xb,Yb,F)) 


Ge ((¥ YbXeg)(E U)(qi1(T11,F) av etc)) > 
(¥ Ypb)(E Xb) d(Xb,Yb,F) 
The sketch of the proof of the second step is the same as tor 
progressione Modus ponens then gives correctness of regression: 


Ge ((¥ Yb) (¥ Xg)(¥ U)(p11(T11,F) av etc)) > [al(z)] D 


4-5-5 Termination Cf The Progression/Rewression Algorithms 


The answer-generation process always terminates in the 
propositional case because only a finite number of clauses can be 
formed fron a finite set or propositions (O-ary predicates). 
Although resolution (or any other complete question~-answering 
mechanism) does not always terminate for full first-order logic; one 
would hope that the quantifier-ordering rules suffice to guarantee 


terminatione 


Unfortunately, this is not always the CaS@e Although the 
number of ground instances of all the clauses is finite, situations 
arise in which arbitrarily long clauses containing variables are 
createde This phenomenon is a concern to researchers in deductive 


question-answering on data baseSe Infinite deductions are possible 
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when the set of clauses contains cycles [lewis 75]*; a cycie 
arises, tor example, from the recursive axiom 

¥xyz ((on(xyy) A abovely,z)) > above(x;2z)) 
Even if no cycles appear in the clause form of Gs ana the world 


description D, cycles may appear when the query clauses are added. 


Several situations can arise in the answer-wveneration portion 


of the algorithm: 


1. A finite nunber of answers are generated and the alyorithn 


halts. 


2. Only a finite number otf answers need be pwenerated, but scme 


cycle(s) lead to an infinite series of resolutions. 


Ge An infinite number of Siggniticantly different answers are 
eenerated. The strongest provable postcondition (weakest provable 


precondition) cannot be represented by a finite E-first (¥-first) 


formulae 


ee ee ee ee ee ee ee ee ee ee ee ee ee ee 


* Formally, a cycle is a set of clauses of the form 


~L1(X1) Vv 2x2") Vieose 
3=1L2(X2) Vv Lat (X3*) V eee 
aLG(x.)) Vv L4*(x4°) V eee 


aLn( Xn) wv Poletti! ) V eee 


where Li(Xi), Liat: Be ies) are literals; and there iS a unifying 
substitution $ such that Li(T)=Li'(7) for 1<=i<=n. 


{Reiter 78] discusses a number of techniques for "neutralizing" 


certain forms ot cycles. 
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The examples presented in this paper fall in the first two 
categorieSse In these examples, turthermore, the simple heuristic of 
Subsumption cuts all infinite deductive paths [Chang 73].e- <A clause 


et 


L subsumes a clause M if a variant of L is contained in Me We 
eliminate Subsumed clauses, as they are generated, from the clause 
sete The ans predicates are considered part ot the clause when 
testing for subsumptione Ee: 

p(x) v ansi(x) does subsume p(y) v ans1(C44) 

p(x) v ansi(x) does not subsume p(C1) 
The notion is that a subsuming clause must not have an ancestor 
derived from a dynanic Axion, which is lacked by the subsumed 
clausee For each answer clause lost because one of its ancestors is 


subsumed, there is an equivalent or stronger answer clause with the 


subsuming clause as ancestore 


The following planning problem demonstrates the third case, 
where heuristics are to no avail, because the regression of a 
formula is not finitely realizable. Let G contain only 

Gs 
¥xyz ((on(x;,y) A abovely;z)) > above(x;z)) 
¥xy (onlxyy) 2 above(xsy)) 
Gd 
¥xy (onl(x;y) = [A] on (xyy)) 
Try calculating A\above(C,;D). The weakest computable precondition 
is 
on(C,;D) v 
(E x1t)(on(C,x1) a on(x1,D)) v 
(E x1x2)(on(Cyx1l) A onl(x1l,yx2) A on(x2,D)) v 


(& x1ix2x3)(on(C,x1) A on(x1,x2) A on(x2_,x3) A on(x3,D)) 
v eee forever 
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The obvious precondition, above(C,b), can't be obtained, because we 


have deliberately neglected to provide a frame axiom tor above. 


Simply stopping the answer &eneration process at some pre-set 
time limit, or establishing a length-limit for clauses, does not 
aftect correctness (but of course risks the loss of some solutions). 
The ultimate solution may Le to revamp BIGRESS so that it does not 
calculate the entire progression or regression of a formula at once, 


but only portions on an "as needed" basis. * 


4-5-6 Efficiency Of Regression And Progression 


We have begeed the question of efficiency; having leit the 
warn confines of STRIPS, the combinatorial problems of frame axioms 


appear in full force. 


In particular, the interaction of the frame axioms tor equality 
and the theorem-prover's mechanism tor handling equality can cause 
combinatorial explosion intolerable in even the most trivial 
implementatione The clause "x=y" paramodulates against any other 
clause. Yet no siwnificant answers are iliost if the theorem prover 
only resolves this clause 76) that at least one ot its variables 
unifies with a skolem functione Equality predicates in clauses 


Should be evaluated whenever possible, and tautologies removede 


The postcondition is not weakened (precondition is not 


strengthened ) if Rrounod instances ort invariant predicates which 


* See [Waldinger 77) for an argunent for the undeSirability of 
calculating, at once, the couplete progression of a condition 


through an actione 
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appear as domain constraints are disregarded by the theorem provere 
The frame axioms for such predicates force the resolution procedure 
to extract the "intensions" of certain answer SetSe This means, in 


particular, that not all of Ge need be worked withe 


For example, suppose 
Gs 
virus(SERM1) 


virus(GERM2) 


virus (GERMYS9S9) 
Gd 
¥y(virus(ly) S{irradiate] mutated(y) ) 
Vy(virus(y) csfirradiate] virus(y)) 
¥y(-avirus(y) salirradiate) ~virus(y)) 
Virus is invariante Using the full set of axioms in calculating the 


effect of irradiate on any state gives 


‘true/irradiate ¥y(avirus(y) v mutated(y) ) 


A mutated(GERM1) 
A mutated(GERM2) 
A e e e 
A mutated(GERM9S9S9) 
If no axioms from Gs are used, one obtains the shorter 


true/irradiate = ¥y(-~virus(y) v mutated(y)) 


These formulas are equivalent under Ge 


Every significant answer should have an ancestor: in either a 
non-frame dynamic axiom or the given world descriptione 
Completeness is not weakenedy since the only answers lost lead to 
post/pre conditions derivable from the static axioms alonee This 


may be the key to a successful implementation: it helps keep keeps 
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the information stored in the static axioms from being duplicated in 


each world description. 


The very lack of a built-in seluticon (with corresponding 
built-in limitations) to the frame and equality problems in the DL 
approach makes it a yood framework for testing various solvents 


ayainst these viscous ditficulties. 


4.6 DETERMINISTIC CCNTROL STRATEGIES 


The bare-bones HIGRESS algorithm says little about how ac tions 
and tests are actually chosen, and at what point oacktracking 
OCCUrS .e To implement BIGRESS on a real, Serial machine, its 
non-deterministic "choice" operation must be Simulated by a 
deterministic control strategy. Such a strateyuy seeks to strike a 
balance between two goals: tinding any possible solution 


(completeness), and finding a solution quickly (efficiency). 


Ags shown in 4.2322, "non-deterministic" BIGRKESS*'s completeness 
rests on completeness of the prowression and regression functionse 
When the space of state descriptions is finite (as in the 
propositional case), a depth-first deterministic strategy can be 
complete, civen completeness of the auxiliary functions. Loops in 
the Search space can be eliminated by extra checkin, in Liveforward 
and Livebackward, as Sugyvested in [{Rosenschein 681]. Let BIGRESS 
take as parameters not only the Lists R and S of the current intial 
and goal descriptions, but descriptions of all previously visited 
statese Prune progressed descriptions implied by any old 


description, or regressed descriptions which imply any old 
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description.e 


In the first-order case; the state space can be infinite, as in 
the second socks example (Section 5-2). Some form of breadth-first 
search is needed for completeneSSe For example: Effectively 
enumerate the sets of atomic actions and non-modal wffSe Initialize 
some global variable I to le Find all plans of length less than or 
egual to I (ieee, I calls to BIGRESS) containing no action or test 


numbered higher than Ie Increment J and repeat. 


A breadth-first bidirectional search (alternating choices from 
Liveforward and Livebackward) is suprisingly efficient for fairly 
Short plans [Nilsson 80]. Efficiency is increased by heuristically 
ordering the sets generated by Liveforward, Livebackward, and 
Nontrive AS in STRIPS, one could analyze the partial proof 


constructed ina failed stopping test as a basis for guessing a good 


next actione 


In summary: we defined a first-order planning problem, and 
extended the propositional provability;, progression, and regression 
functionse Correctness was proved, and problems of completeness 


discussede 


CHAPTER 5 


EXAMPLES OF PLANNING IN TDL 


I shall present a number ot planning problens which demonstrate 
the stren,g, ths of the TDL framework.e Examples Shall include 
disjunctive goals and world descrirtions, derived predicates, 
actions with Side eftects, nondeterministic actions, and 
"distributed" action detinitions; all features which are difficult 


to accomcdate in other systems. 


Sel BLOCKS AND BCXES WORLD 


That hnoariest cf settings, the blocks world, can still provide 
sone challenying problems. tne domain will contain a table anda 
number of boxes and blockSe A block can be Supported by the table 
or one of tine boxese (Blocks won't be stacked directly on other 


blocks.) Rlecks can be cubes, conesy and spherese Tne static 


axioms include: 


box (BOX1), box(BCX2), box (BCXx3) 

block (BLEL), eee, block( BLKG) 

¥x ((bex(x) v x=TASLE) = sup(x)) 

¥xyz ((onlxry) A onl xz)) > y=z) 

¥xyz ((shapelx;yy) A shapel(x:z)) > y=z) 


EXAMPLES GF PLANNING IN TDL Page 72 


Domain constraints shall be added as needed to iliustrate various 
featurese Assune that Gd includes appropriate frame axioms for all 


actions so that box, block, and Shape are invariant. 


suppose that a robot hand is able to manipulate one block at a 
timee 
¥ xy ((on(x,y) A handenpty) > [pickup(x,y)] hold(x)) 


¥ xy ((Chold(x) A suply)) > [putdown(x,y)] (onlxsy) 
A handempty ) ) 


frame axioms: 

¥ xyzw (onl(zyw) a z#x) > [pickup(x,y)] onlz,w)) 

¥ xyzw (on(zy»w) 2 [putdown(x,y)] on(z,w)) 
A plan constraint can include an indefinite goal; tor instance, to 
obtain a cube or a cone on BOX2 from a state where 

shape(BLK3, CUBE) 

Shape(BLK4, SPHERE) 

shape (BLKS,CONE) 

on(BLK3, BOX1) 

on(BLK4,TABLE) 

on(BLKS,TABLE) 
is. true, Gs Should be expanded to include the first three 
propositions above, and RES(u) should be 

(on(BLK3,BOX1) A on(BLK4,TABLE) aA 

on(BLK5,TABLE) A handempty ) 
> Cu] (E x) (on(x,BOX2) aA (shape(x,CUBE) 
v shape(x,CONE))) ) 


Of course, BIGRESS can return either 


( pickup( BLKJ,BCX1) 3; putdown(BLK3,BCX2) J 


{pickup (BLK5, TABLE) ;putdown(BLK5,BOX2) J 
A more interesting problem arises when less is known about the shape 


of the blocks. Use the same plan constraint when Gs contains only 
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shape(HLKJ,;CUBE) v shape(BLKS, CUBE) 
A Straightforward search by the planner could come up with the 
svlution 


{pickup (BLKJ, BOX L) 5 putdown( BLK, BOX 2); 
Rickup(UBLKS, TABLE) ;putdown( BLK5,BOX2) J 


Since one of SLK3 or 8BLKS must be ai cube, putting both on BOX2 
assures that at least a cube is there. If the predicate Shape can 
be used as a test, then a more efficient solution can be feunde 
{shape(3LK3,CUBE) - 
(pickup(BLK3,HOX1); putdown(BPLK3,LO0X2)), 
(pickup(BLKS,TABLE) ; putcdown(bLK5,BCX2)) J 


Note that NonTriv would never return the test shape(ULK4,CUBE), 


because one can derive trom the axioms ashape(RLk4, CUBE). 


The blocks world [I've described so tar Lacks any interesting 
interactions between succeSSive actionse To liven things up a bit, 
the boxes will be wiven Jids which can be opened or closed. Blocks 
can be put in or removed from a box when the box is open. When the 
lid is closed, blocks can be piied on top of the boxe Let Gd 
contain 


¥ xy ((inlx,y) A -~closed(y) A handempty) > 
{[pickup(x,y)]) told(x)) 


¥ xy ((on(xyy) A handempty > 
{pickup(x,y)] totd(x)) 


¥ xy ((hold(a) a boxly) A aclosed(y)) 2 
[putdown(x,y)] (inlxsy) ” handempty) ) 


¥ xy ((hold(x) a suply) a closedly)) > 
{putdown(x;sy)] (on(xsy) A handempty)) 


¥ x ({-closed(x) A box(x)) 2 
{ shut(x)]}] closed(x)) 


WV x ((closed(x) a box(x)) > 
[open(x)] ~closed(x)) 


Note that the effect of the putdown action depends upon the state of 
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world in which it is performed: if the lid is open, the block goes 
into the box; otherwise, it ees onto the boxe Gs should include 
closed(TABLE). The frame axioms are Straightforward, except for the 
open actione It has the side effect of dumping all the blocks which 
were resting on the lid onto the table. The frame axioms are: 


¥ xwz ((on(w,z) aA z#x) 2? 
{open(x)] on(wyz)) 


¥ xw ((closed(x) A box(x) A on(w,yx)) 2 
[ open(x)] on(w,TABLE) ) 


¥ xywz ((inlw,z) A w#x) > 
[pickup(x,y)] in(wyz)) 


¥ xywz ((on(w,yz) A w#x) D> 
[pickup(x,y)] on(w,z)) 


+ pure frame axioms for 


open: hold, in 
shut: hold, im, on 
pickup: closed 


putdown: closed, in, on 
Open is thus an influential action, as discussed in chapter 2: i 


affects the truth values of an arbitrary number of relationships. 


"Non-linear" planners such as NOAH create separate subplans to 
achieve each conjunct in a conjunctive goal, then heuristically 
interleave the subpians to achieve the combined goale The greater 
the number of potential interactions between operators -- the more 
ways in which one action can undo the effect of another -- the more 
costly a non-linear approach to planning becomeS, and the more 
attractive a straightforward linear planner like BIGRESS- Consider 
the problem specified by the constraint 

(in(BLK1,BOX1) a in(BLK2,BOx1) 


A closed(BOX1) A handempty) 
> fu) (on(BLK1,BOX1) A on(BLK2,BOX1)) 
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BLK1 BLK 2 


Oe a he a ee ee ce ee ca 

I I I a 

l if to I I 

1 BLE Bik 2. 0 [ si 

I f I I 

I------------ 1 = = — = =~ I 
HOX 1 BOY 


The shortest plan to do this takes eiyznht steps: 


[open( BOXL) ;pickup(3LK1,HOX1) 3; putdown(BLK1, TABLE) 
pickup (BLK 2, BCX1) ;¢lose(BCX1) 3; putdown(BLK2,RCX1) 
pickup(BOX1, TABLE); putdown(BLk1,BOX1) } 


A non-linear planner would create Separate subplans to put BLKI1 and 


BLK2 on BOX1. 


fopen(FOXL) ;pickup(SLK1,#OX1);close(BOX1); 
putdown( BLK 1, B0X1) ) 


and 


[Lopen(BOX1L) ;pickup(3LK2;, KBCX1);close(BOX1); 
tutdown(BLK2,B0OX1) ) 


There is no way to linearize these subplans to achieve tne desired 
woale (Sacerdoti 77 4j reiers to such a Situation as a 
"“double-cross". Rather sophisticated heuristics (which are only 
partially implemented in NOAH) are needed to insert new steps into 
the plan to temporarily place BLKI on the table while removing BLK2. 
BIGRESS, of cuurSsey, would have to perform a great deal more pure 
search to tind its solution; but the use of a planning hierarchy 
(see section 6.2) can drastically reduce the search while retaining 


linearitye 


lt is often useful to include axioms which essentially detiine a 
new predicate in terms of more basic predicates. For instance, the 
predicate "at" could hoid ot a block which is eitker on or in a boxy, 


and "nextto" of blocks which are on the same box: 
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¥ xy (at( x,y) = (onl(xey) v inlx,y))) 

¥ xy (nextto(x;y) = ((on(x,FOX1) aA only,BOX1)) v 
(on(x,BOX2) a on(ly,BOX2))v 
(on(x,BOX3) an on(y;BOX3))) 

Planning systems by [Fahlman 74] and [Fikes 75] distinguished 
such derived, or secondary relationships from the more basic primary 
relationshipse Their systems gained efficiency by not explicity 
including rules for repressing or progressing secondary 
relationshirs through actionSse The idea was that the information 
encoded by a secondary proposition in a world description was purely 
redundante The planner would keep track of the primary 


relationships used in the deduction of each secondary relationshipe 


If any of the former were falsified, the latter was deletede 


In the TDL framework, no special dynamic axioms (including 
franie axioms) need be included for predicates whose instances are 
always equivalent to a (particular) formula not containing that 
predicate. The planner need not keep track of how any predicate was 
derived; the progression or regression algorithms effectively 
translate secondary relationships to a primary form as needede For 
instance, uSing the axions described so far, the planner can 
calculate 

at(BLK1,BOX1)/open(BOX1) = 
aclosed(BOX1) an (in(BLK1,BOX1) v 
on( BLK1, TABLE) ) 

The Fahlman and Fikes systems didn't allow secondary 
relationships to explicitly appear in the problem description; such 
relationships could never be deleted, since no chain of deductions 


from primary relationships would be kKnowne But in our purely 
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logical framework, the constraint 


(at(BLKL,H0OX2) a nextto(BLK3,BLK1)) > 
Cu) -wnextto(HLK3,HLK1) 


is perfectly acceptable. 


5e2 THE SOCKS WORLE 


A tire on my atvtonobile bursts as I Speed down the New York 
Thruway; the spare in the trunk is patched and pressurizeua, since I 
have planned tor this continyency « Two simultaneous blowouts leave 
me stranded in the deepening SnNOWeecee You pluck a Christmas candy 
from the xyaily wrapped boxe Nougat, carmel, or cherry would Satisfy 
your craving, but a Sulphur-filled center leaves you understandably 


—— 


surprised and angrye 


Chance plays a Significant role in most everyday atfairse We 
are able to create and carry out plans because we assume 
(justifiably or not) that the randow nature of events is constrained 


in some known waye 


In the typical blocks-world scenario, chance is completely 
eliminated. Every action modifies the world in some known, 
fully-speci fied manner -- talsiitying some propositions, establishing 
otherse indeed, only such actions can be represented by add/delete 


Jist peirs. 


The TOL tramework allows one to model non-deternministic 


actionSe Semantically, a nen-deterministic action A relates some 


worlc to more than ene world: 
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E I,J,;K such that (I,J) e€ M(A), 
(I,K) e€ M(A), J # K 
The postcondition of a non-deterministic action and a state 
will generally inc lude disjunctive and existentially-quantified 


informatione 


The famous "three-socks problem" incorporates a carefully 
controlled element of chancee You stand in a totally dark room 
before a dresser full of loose socks; some black and some whitee 
The only action you can perform is to pull a sock from the dresser 
and drop it on the table. How many socks must you remove betore you 
can be sure that a matching pair is laid out? In the following 
Simple formulation, the predicate was_ontable holds ot socks which 
were on the table prior to the most recent "pick" action. The 
proposition P states that a black or white sock is on the table 
which wasn't there before the most recent actione 

Gs: P > Ex({ontable(x) A ~was_ontable(x) a 
(tlack(x) v white(x))) 
Gd: true > [pick] P 
¥y(ontable(y) > {pick] ontable(y) A was_ontable(y) ) 
frame axions: 
¥y(white(y) > ({pick] white(y)) 
¥y(black(y) > [pick] black(y) ) 
R(u): true > [u] Exy (ontable(x) aA ontablely) a 
x#y A 
(((black(x) a black(y)) v 
(white(x) a white(y)))) 
BIGRESS quickly finds the solution pick; pick; pick. A forward 


search develops the following sequence of state descriptions. 
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true/pick = P 
(true/pick)/pick = 
Fx fontable(x) A was_ontanle(x) a 
(pblack(x) v white(x)) a 
P) 
((true/pick)/pick)/pick = 
Ex x (ontable(x) a was_ontable(x) a 
(black(x) v white(x)) a 
X#x! A 
ontable(x') A was ontable(x') a 
(black(x') v white(x')) a 
) 
The final formula implies the cesired pwuale Note that the plauner 
inters (in the progression progress) that the two socks tnat are on 
the table atter the second pick aren't equal, Since was _ ontable 


holds tor one and ~was_ ontable for the other, and passes this 


inequality through the tinal pick actione 


While this problem may not appear too impressive (no 
intelLlijvence is required in the search SS only one path is 
possible), it is beyond the capabilities of many planning systemse 
Of the STR UIPS-based planners discussed here, only NOAH can be 
prowrammed tor actions like "pick up a random obyect from a pile. 
But NOAH's non-linear planning strategy would get it into trouble. 
It would deal the disjunctive yvoal "obtain two black Ok two white 
socks! hy creating two subproblems, one to obtain two black socks 
and one to obtain two white sccksy, with the hope of later 
incorporatinz in the final pian the supproblem solution which proved 


eaSlest to obtaine In this case, bothn attempts are bound to faile 


An odd feature of the above set of axioms is that althotszh they 
sutiicea to s0lve the problemy they do not guarantee the 


completeness of BIGRESS's searche The formula 
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(((true/pick)/pick)/pick) implies that the domain contains at least 
three entitiese The frame axions for equality and the Nhalting 
axiom" (<pick>true) allow one to conclude that 

Gt Exyz (x#y a y#z a z#x) 
--which can't be obtained from the static axioms alonee In fact, 
such reasoning reveals that the domain must be infinite in any 


structure satisfying the dynamic axiomse 


The problem is that the socks are appearing out of thin aire A 
more elaborate formulation makes sure that socks come from the 
dressere 


Gs: P > &x (ontable(x) A a~was_ontable(x) A 
was_indresser(x)) 


Ga: Y¥ylindresserly) > [pick] P) 


¥y(ontable(y) 2 [pick] (was_ontable(y) a 
ontable(y))) 


¥y(indresser(y) > [pick] (was_indresser(y) A 
(indresser(ly) v 


ontable(y)))) 


¥y(sindresserl(y) > (aindresser(y) a 
awas_indresser(y))) 


The most popular version of the socks problem adds the tact that the 
dresser initially contains exactly 4 (or any fixed number) black 
socks and 4 white sockse One formulation includes a domain closure 
axiom * for things in the dresSere 
Add to Gs: 
black(3S1), black(S2), black(S3), black(S4) 
white(S5), white(S6), white(S7), white(S8) 


* MVy(indresser(y) 2 (y=S1 veces v y=S4)) 
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ku): indresser(S1) A e+«e A indresser(Ss) 
> [uJ] Exy lontahble(x) aA ontablel(y) a 
x#y A 


((bLaci( x) a blackly)) v 
(white(x) a whitely)))) 


Any number ot variations can be devised: eget a pair ot black socks 
only (which now has the solution 
pick; pick; pick;spick;pich;pickj;pick;pick) ; get a particular sock; 


allow multiple colors, etce 


Even putting the domain closure axiom aside, it is no longer 
derivable that the domain is infliniteecece but the Search Space for a 
particular y;roblem may remain intinite. Note that (without *) 

true/pick > Ex¥y (rnindresserly) v ontable(x)) 
(true/s:ick)/pick > Exx'¥y ( -mindresser(l(y) v 
(ontable(x) a 
ontable(x') a 
x#x")) 
and so forthe Starting from a state of conpilete ignorance (true), 
applying pe Welk N tines results in the knowledge that either the 
dresser is eupty (¥y(nrindresser({y))) or N socks are one the tablee 
It is-never the case that 
Gt true/pick**M 3 true/pick**N 


tor M<N, so the sgimple heuristics in LiveForward and LiveBackwaid to 


detect loops will never prune this branch of the Search trees 


ae 3 DUNGEONS WORLD 


A particular representation of an action may fail to capture 
all relevant effects ot that action because the representation 
lam uage lacks the necessary expressive Ppowere AS we have noted, it 


is difficult or impossible to adequately model a non-deterministic 


EXAMPLES OF PLANNING IN TDL Page 82 


action if effects are specified merely by add/delete lists of 
literalse Yet however rich the basic framework is -- whether one 
uses logical axioms, or syntactic operaturS, or procedures —— the 
system designer may Simply be unaware oft all the relevant effects of 
the actione It is desirable that the action representation can be 
easily strengthened, and that no "incorrect" plans (incorrect in the 
sense of not working as expected when actually carried out in the 


real world) were generated using, the weaker representatione 


Each TDL dynamic axiom specifies sone partial effects of an 
actione Additional axioms refering to the same action can be added 
as needed; indeed, such a nodular style is encouragede 
Representing an action by a number of short axioms enhances the 
perspicuity of the systeme It appears rather more difficult to 
extend a planning system Dy, say, rewriting QLISP procedures or 


STRIPS" operators. Both approaches sufter from the "fone operator 


per action" syndromee 


More importantly, TDL's cautious approach to the frame problem 

-- insisting on explicit frame axioms -- assures us that if 

Gre R > [Plan]JS 
and Gt is a consistent extension of G, that 

Gtt R > {PlanJS 
So it is always safe to use a smaller set of ruleSe Under the 
STRIPS assumption, redefining an action A by lengthening its 
precondition or delete list to include a proposition B insures that 
there will be plans which are solutions to problems using the old 
definition of A, but are not solutions using the new definitione 


For a trivial example, when 
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OLdA: ore: p 
del: (@ 
add: Q 

and 
newaA: pre: Pp 
add: Q 


then oldA is a plan to obtain C A B trom PA B, but newA isn't. 
Even if the system designer initially suspected that A may falsify 
By, She would not have heen justified in using the form newA in the 


first place; because newA iS also a plan to obtain -—B from Pe 


[t is useful to have multiple axioms for an action when it 
effect crucially depends upon the state of the world in which it is 


executede 


In the zane of Dungeons and Dragons, the walk action moves a 
player throuzh a maze of roors: and tunnelse The only parameter to 
walk is a compass directione Ihe planner may have a partial image 
of the action: 

at(FOPEST) > [walk(NORTH)] at(CAVE) 


at(CAVE) > {walk(NOKTH)] at( BOTTOMLESS PIT) v 
at (TREASURE _ RCOM) 


Discoverin, that walking SOUTH from CAVE takes you to WIZAKDS LAIR 
could be acconmodated by the addition of another axiome If the 
axioms above are strengthened by adding: 

at(CAVE) > [walk(NORTH)] at(LTREASUKE PCOM) 
the progression algorithm correctly computes that 
at(CAVE)/walk( NORTH) = at( TREASURE RCOM). A "smart" plannea mipthnt 
notice that the second axion beccones redundant, but this is not 


necessary to insure correctnesS-e 


CHAPTER 6 


HIERARCHICAL PLANNING 


"Hierarchical decomposition" is a buzzword in almost any area 
of computer science, from programming languages to machine visione 
The greatest appeal of the dynamic logic framework may be its 


formalization of a glanning hierarchye 


As in the propoSitinal case, the dynamic axioms at one level 
become plan constraints at a lower level. But the presence of 


parameterized actions make it convenient to associate the tree 


Recall thow G(la({Z)), the Z-instance of a, was formed by 
gathering the dynanic axioms for a and applying specialization to 
obtain the instances of the axioms with parameter list Ze Each node 
of a problenm/solution tree is Single-level planning problem and 
solution pair, in the same vocabularye The node has a child for 
each instance of an action (ieee; each atomic action) which appears 
in its solutione Where 

<<VOC , G , RES(u(H)) >, B > 


k k k 
is a k-level node, then tor each atomic action a(Z) which appears in 
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Bh, 
<< VOC saG » G (a(Z))>, Bb > 
k+1 k+1 ik k+1 


is a child. The vocabulary (way the world is described) may change 


from level to levele 


The tree may be constructed top-aown: deternine the top-node 
proklem and solution; form a level 2 planning problem for each 
atonic action which appears in the top-level solution; trom each 


level 2 problem and solution create a child node; and continue on 


down the treee So, if B = alC);alD), then two level two planning 
problems are proposed; one with constraint G (a(C)), the other 
G (a(D)). 


Alternatively, it may be possible to precompute parts of the 
tree. The original dynamic axioms for a, instead ot a Set of their 
instances, may Simply be taken as plan conStraintSe The result isa 
generalized iLower-level plan tac pertorm the actions; plans to 
perform instances of the action are produced by a Simple syntactic 
transformation of the general solutione This is made precise by the 
following 

Theorem: Suppose <VOCy Gy G'(al(Z))> has solution Be. 
Then for any xlyeeesxj € VAR and tlyeoeg tj € TERMS 
<VOC, %, G'M al(Z(t1/x1, «2+, tj/xj}) )> 


has solution B(t1/x1l, cece, tij/xj}e 
Proof: Induction on B and jy repeatedly applying Ad. 


— = = 


Two examples follow, demonstrating both appreacheSe The 
overall solution to a hierarchical planning problem is obtain trom 
the tree by replacing each atomic action a(Z) in b by the plan b 


in the child with constraint G (a(Z)) in bottom-up ordere The new 


plan at the root solves the high-Level problem in the lowest-level 
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vocabularye 


601 DUNGEONS WORLD, CONTINUED 


This example demonstrates a tri-level decomposition of the 
dungeons world mentioned in 53-56 Tne top level reveals rooms which 
contain objectS, and includes an action for transfering objects from 
room to roome The second level introduces a robot which actually 
moves the objects about. Level 3 breaks the robot's motion down 
into unit stepSe The link between levels 1 and 2 can be entirely 


precomputed, but that from 2 to 3 is better computed as needede 


Define the top level vocabulary and domain constraints as 
follows. 
Level 1 
vocl 
CON]: SWORD, GCLD, eee, JEWELS 
HOME, CAVE, e@eeq LAIR 
PRED1: lloc, room 


ACTI: transfer 


Gsl: 
room(HOME), eee, room( LAIR) 


Gd1: 
¥ tobj tstrt tfin ((lloc(tobj,tstrt) A room(tfin)) 
> [transfer(tobj, tstrt, tfin)] lloc(tobj,tfin)) 
frame axiom: 
¥ tobj tstrt tfin tfobj tirm 
((lloc(tfobj,tfrm) a tfobj#tobj) 
> [transfer(tobj,; tstrt, tfin)] lloc(tfobj, tfrm)) 
The predicate lloc holds of an object and the room in which it is 


locatede The planning problem 


<VOC1, Gl, RESiI(u) = 
{ (loc(GOLD,CAVE) Aa loc(JEWELS,LAIR) ) 
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> Lu] Clee(GOLD,HOM:) aA loc(JEWELS,HCME)) } > 
is solved by [(transter(GCLD,CAVE,HOME); transfer (JEWELS,LAIP,HOME) J. 
Of course, suc h a plan is easier Synthesized than executed -- 


someone must go out and fetch the valuablese 


Level 2 introduces a robot who can be "at" various locationse 
The "go't action moves him from room to room, moving aS well any 
objects te is carryinee Grab and drop, as their names suggest, 


initiate and terminate the carrying of an object. 


The "basic" level 2 vocabulary and axioms are: 


ee 


CON 2: HOME 
PRKED2: Carry, at, loc, room 
kOe wrab, drop, go 
Gs2: 
¥x y ((carry(x) a atly)) > locl(x,y)) 


¥x y z ((loc(x,y) A loc(x,z)) > y=z) 


Gd2Z: 
@o: main axiom 


¥ strt fin ((at(strt) A room(fin)) 
> (go(strt,fin)) at(fin)) 


go: trame axioms 


¥ strt fin xfobj wirm ((locletondj,gfrm) A xacarry(gfobj)) 
> (go(strt,fin)]) loc(gfobj,geirm) ) 


¥ etrt fin gfobj (carry(gfoh,i) 
> [go(strt,fin)]) carrylgtobj)) 


¥ strt fin gfchj (acarrylgefob) 
> (go(strt,tin)]) ncarry(gfobj)) 


erab, drop: main axions 


¥ obj rm ((at(rm) A loc(obj;rm) ) 
> [grab(cebj)] carry(lobJj)) 


¥ obj (carry(lob Jj) 
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> {[drop(obj) ] ~acarry(ob,j) ) 
erab, drop: frame axioms 


¥ obj fobj ((-acarry(fobj) A fobj#obj) 
> [grab(obj)] ~carry( fob,j) ) 


¥ obj fobj ((carry(fobj) A fobj#obj) 
2 [(droplboj)] carry(fobj) ) 


A pure frame axioms: 
grab: carry, loc, at 
drop: carry, loc, at 
The level 2 actions are used to solve the level 1 domain 
constraints. But to synthesize a plan to direct the robot anywhere, 
his initial location must be known -- information which does not 
explicitly appear in the high-level descriptione One way around 
this is to simply insist that the robot is at some particular known 
location -- for instance, HCME -- in every state in the high-level 
plane This is (a bit underhandedly) assured by translating the 
"“Tloc(x,y)" predicate which appears in the pre and post condition of 
every level 1 dynamic axiom as "x is in room y; and the robot is at 
HONE". So Gs2 is augmented by 


¥ x (lloc(x) = (at(HOME) A lLoc(x))) 


The planner has the choice of precomputing a level 2 solution 
to the constraint set Gi(transfer(tobj,tstrt,tfin)), or merely 
solving the individual instances of transfer as they arisee The 
former course is preferable heree The level 2 planning problem 

<VOC2, G2, Glil(transfer(tobj,tstrt,tfin))> 
contains two plan constraints; the initial call to BIGRESS is 


BIGRESS( < lloc(tobj,tstrt) aA room(tfin) , 
lloc(tfobj,tfrm) A tfobjf#ftobj >, 


< lloc(tobj,tfin) , 
lloc(tfobj,tfrm) > ) 
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The main and frame axioms for transter are treated as separate 
problems whicn must have the same solutione The variables tub jy, 
tstrt, and tfin may appear in the Solution, Since they will be 
replaced hy particular constants when an instance of transfer is 
executed. The variables tfobj and tfirm may not; there is no one 
object you can pcint to and say, "this is the object not being 


moved!" The chart below traces the parallel sequences of state 


descriptions develoyed on a forward searche 
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ri r2 
initial Lloc(tobj,tstrt) a lloc(tfobj,tfrm) a 
room(tfin) tfobj# toby 


= loc(tobj,tstrt) a loc(tfobj,tfirm) a 


at(HCME) a at(HCME) a 

room(tfin) tfob jétobj 

/go(HOME, tstrt) loc(tobj,;tstrt) a at(tstrt) a 
at(tstrt) ((carry(ttobj) a 


tfirm=HOME ) 
v loc(tfobj,titfrm) ) 


/gerab(tobj) loc(tobj,tstrt) a " 
at(tstrt) A carry(tob Jj) 


/gol(tstrt,tfin) at(tfin) A carry(tobj) at(tfin) a 
((carry(tfobj) a 
tfirm=HCME ) 
v loc(tfobj,tirm) ) 


/drop(tobj) at(tfin) A xacarry(tobj) Aa _ 
loc(tobj,ttin) 


/go(tfin, HOME) at(HOME) a at (HOME) a 
acarry(tobj) a ((carry(tfobj) a 
loc(tobj,tfin) t£rm=HOME) 


v loc(tfobj,ttrm) ) 


lloc(tobj, tfin) =‘lloc(tfobj,tfrm) 


Correctness of BIGRESS lets us conclude that 


G2t+ ¥ tobj tstrt tfin ((lloc(tobj,tstrt) aA room(tfin) ) 
> [go(HOME,tstrt);erab(tobj);go(tstrt,tfin) ; 
drop(tobj) ;go(tfin, HOME) } 
lloc(tobj,tfin) ) 


G2t ¥ tobj tstrt tfin tfobj tfrm 
((lloc(tfobj,tfrm) A tfobj#tob,j) 
> [go(HOME,tstrt);grab(tobj);go(tstrt,tfin); 
drop (tobj);go(tfin, HOME) J 
lloc(tfobj,tifrm) ) 
Specialization (as in the theorem stated earlier) ives low level 


plans to perform the particular yo atomic actions (go(HOME,CAVE), 


etc.) needed in the top-level plane 
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Grab and Drop are Siuply atomic actions at the third level as 
well, but zo is replaced by tne walk action; which takes a compass 


direction as its Single parameter. Thus, 


Level 3 

Voc3 

CON 3: HOME, CAVE, eooy LALK 
Ny Ey, Sy W 

PRED): loc, at, carry 
ACTS: walk, grab drop 

Gs3: same as Gs2 

Gd3: 


#rab, drop: same as Gd2 
walk: frame axioms 


¥dir fobj fra ((LlLoc(fobj,frm) a ->~carry(tobj)) 
ISfwalk(dir)]) loc(fobj,frm) ) 


¥ dir fobj (carry(fobj) 
2{walk(ditr)] carry(tob J) ) 


¥ dir fobj (-carry(fob J) 
I(walk( dir) ] -wcarry(tobj) ) 


walk: inain axioms 
at(HOnE) D[watk(N)] at (CAVE) 
at(CAVE) DP[walk(S)] at(HCME) 


at(CAVE) DP{walk(E)) at(LAIR) 
at(LAIR) DPlwalk(W)] at( CAVE) 


Tt is not very teasibie to precompute the solutions to g0 at this 
level; Since a different plan is required to go between any two 


loce tions, a eBeneral soluticn would contain QN**2 conditicnal 


branches, where N is the number cf roomSe 


The planning problem <VCC3, G3, G2(go(HOME,CAVE))> has four 
constraints aaa one tor the main «o axiomy plus each frame axiome 


Some ot the Level 3 solutions: 
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go (HOME,CAVE) walk(N) 
#0 (HOME, HOME) null 
eo (HOME,LAIR) walk(N);waik(E) 


Thus the overall low-level solution to the example planning problem 
is 

walk(N); grab(GOLD); walk(S); drop(GOLD); walk(N); 

walk(E); grab(JEWELS); walk(W)3; walk(S); drop(JEWELS) 

The hierarchy tas considerably reduced the low-level search 
Space, but at the cost of efficiency in the overall plane Note that 
the low-level axiomatization allows the robot to carry more than one 
object. A better solution would be to walk to the CAVE, grab the 
GOLD, proceed directly to the LAIR, and return HOME. Alas, this is 
one of the classic tradeoffs: search efficiency versus optimality 


of the solutione 


6e2 MORE BLOCKS AND BOXES 


What is a "good" high level view of the block and boxes world, 
described in section 5-1? Recall that the world had three boxes, a 
table, and a number of blocks which could rest on a box or the 


table, cr in a boxe 


s1 $3 Ss 
0- =s250 Os = = Se 0+ *=Se— 
I I I I I ie 
I so I s41 I sé. S7 


There are seven surfaces on which a block can rest, labeled S1-S7 
abovee Any planning problem will probably involve’ simply 


rearranging the blocks on these surfaceSe The high level world 


description contains a single action move(obj,;olds,news), to move a 
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block fron one surface to another. 


Next, we must decide what side effects, uae any, move hase 
Taking a klock ott of a box (from S2, S4, S6) disturbs any blocks 
resting on the box (on 35J, S3, S5)e "Hiding" this fact from the top 
level view would either lead to a "heuristic", rather than an exact, 
hierarchy of Levels, or require that the low level plan which 
implemen ts move explicitly undo the side-effects. While the latter 
course may he attractive in Some caseS, more efficient higt.-level 
plans (at the cost of Some extra effort in calculating the 
regressions and progressions throuch move) are obtained by 


percolating, the side effects ali the way to the tope 


Surtaces 1,3,5 are marked as “above" surtaces 244,66 The trame 
axioms for move check whether each block not being explicitly tioved 
is above either the source or destination surfaceSe 


VOC1: PEK 1, «ce, HLKIO 
Sly eooogy S7 


PRED1: surface, above, ons 

Gsl: 
¥ x (surface(x) = (x=S1 Vv eee v x=S7)) 
¥ x» y (above(xy,y) ( 


(x=S1 A y=S2) v eee v (x=S5 a y=S6))) 
¥ x y (uons(x,y) 2 Surfacely)) 


Gdl: 
¥ oby olds news ((ons(ob.j,olds) A surface(news) ) 
a>{ move(obj,oldsynews) ] ons(obj;,news) ) 


¥ obj oldS news w 24 
(Consiwyz) aA whubj A ravovel(z,0lds) A 7abovel(z,news)) 


2{movel(obj,;olds,news) ] ons(v,z)) 


¥ obj olds news w 7 
({ons(w,z) A (abovel(z,clds) v abovelz;,news))) 
>[ move (objyoldsynews) ] ons(obj,S7) ) 
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Given these axiors, the problem discussed in 5-1 to move two 
blocks from inside BOX1 to its top uses the constraint 

(ons(BLK1,S2) a ons(BLK2,S2)) 
>Cuj (ons(BLK1,S1) Aa ons(BLK2,S1)) 

Backwards search by BIGRESS finds a solution, probably without any 
backtrackinge LiveHackward( ons(BLK1,S1) A ons(BLK2,S1) ) will not 
contain move(BLK1,582,S1) or move(BLK2,S2,31)3 because of the 
constraints on the frame axiomS, the regression of 


ons(BLKi,S1) a ons(BLK2,S1) 


through either action is false, 


and thus 


prunede So BIGRESS must Choose a different spot from which to 
obtain a block; move(BLK1,S7,S1) will doe The regressed goal 
becomes ons(BLK1,S7) A ons(BLK2,S1). Next, the choice of 
move (BLK1,S1,8S7) is pruned; the only reasonable choice is 


move(BLK2,8S2,S1) followed (finally) by move(BK1,S2,S7).- 
level solution is 

move (BLK1,S2,87)3 

move(BLK2,S2, $1) ; 

move(BLK1, Sas S1) 


The low level vocabulary and axioms are given in Sel, 


by translation axions 


so the high 


augmented 


¥ x (ons(x;Si) = (on(x,BOX1) A handempty) ) 

¥ x (ons(x,;S2) = (in(x,BCX1) A handempty)) 

¥ x (ons(x,S3) = (on(x,BOX2) A handempty) ) 

¥ x (ons(x,S4) = (in(x,BCX2) A handempty) ) 

¥ x (ons(x,S5) = (on(x,BCX3) A handempty) ) 

¥ x (ons(x,S6) = (in(x,BOX3) A handempty) ) 

¥ x (ons(x,S7) = (on(x,TABLE) A handempty) ) 
The "closed" predicate does not appear in the high-level vocabulary 
or in the translation axioms, the solutions to move use a test to 


determine this detail. 


The results of the low level planning are 
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high level implemented by 


nove(bLk1,S2,S7) (clLosed(BCX1) ~ open(BOX1),null); 
pickup(BLK1,BOX1); putdown(BLkhl,TALLE) 


move(BLK2,52,S51) (closed(BOX1) ~- open(BOX1),nul1) 
pickup(BLK2,BOX1); close(BOX1); 
putdown( BLK2,BCX1) 


move(bLK1,87,S$1) (closed(BCX1) —~ null,shut(BOX1));3 
pickug(BLK1,S7); putdown(BLK1i,S1) 


The final solution is just, ot course, the concatentation of the 
three plans abovee The second and third test of closed(BOxl1) are 
not necessary (they always fail). Perhaps a post-processing stage 


could optimize the glan by remneving unneeded tests. 


A heuristic hierarchical] ,;Janner vould most likely Suppress the 
side-eftect of move as a detail, and initially come up with the 
"buggy" high level plan [move(ELK1,S2,S1) ;move(BLK2,S2,S81) ].- While 
the cost of repairing this particular plan may be cheap, it is 
interesting to note that retention ot the side-effect in the exact 


decompostion actually helped comustrain the high-level searche 


6-3 SUMMARY 


A hierarchical decomposition of a planning problem can j,.reatly 
increase search efficiency. Imposing a hierarchy involves not only 
decisions as to the tools availabie at each level, but also which 
subproblems should be (can be) solved in advancee ‘The use of plan 
parameters permits the synthesis of general solutions to planning 


problems. 


A strict hierarchy may force more detail to the top level than 


a heuristic hierarchy, but it is not clear if such detail necesSSary 
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degrades search efficiencye (Of course, even an exact hierarchy 


rarely retains all the detail that a MACROP does.) 


The strict hierarchy effectively isolates each sister node, 
elininating the need to check for bad interactionse But it may be 
very desirable to allow some "communication" between sisterse For 
example, when solving the second Subproblem in the last example, the 
Elanner Should have known that BOX1 was left open at the end of the 
first subtaske In other words, an ordered tree may be easier to 
solve than an unordered treee The exact formal mechanism (for 


carrying information from one sister to the next remains to be 


definede 


CHAPTER 7 


FORMAL OBJECTS 


Jel BACKGROUND 


The amount of search performed by a problem solver can often be 
drastically reduced by neuristically ordering the successors to each 
node in the search graphe But it may be difficult to discern the 
“hest!! successor until later in the planning process; or a number 
of successors may lead to essentially the same solution or dead-end. 
In such circumstances it is advantageous to apply a partially 
specified operator to the current node, only completing the 
specification at a later point in the Searche This effectively 
merges a number of descendent branches, while retaining the option 


of splitting off branches as necessary. 


Formal objects are used in one version of this technique 
{Sussman 73]. A formal object is a "dunmy" term introduced by the 
planner; initially, at least, the formal object's referent is only 
partially specified. A simple action containing a formal object as 


a parameter can thus stand tor a range of constant-parameter 


actionSe 
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Mechanisms for manipulating formal objects, or “uninstantiated 
parameters", have appeared in a number of linear and non-linear 
planning systems, including ABSTRIPS and NOAH. We give a high-level 
description of the use of formal objects in the TDL framework. This 
work is valuable in providing a very general basis for the use of 
formal objects in both forward and backward Search, and at least a 
semi-formal treatment of the correctness of plans containing formal 


objectSe 


7-2 BIGRESS WITH FCRMAL CBJECTS 


The formal ob jects AllFormCb,js are a distinct subset of the 


variablese 


A restriction wff is a quantifier-free non-modal formula 


containing only invariant predicates. 


Rwffs(F), where Fis a list of variables, is the set of 
restriction wffs whose free variables are contained in (F u H). (H, 


we recall, is the list of plan parameters. ) 


BIGRESS takes as parameters: 
BIGRESS(R, S, FormOb js; Restrict ) 
where FormOb js c AllFormObjs 
Restrict e¢ Rwffs(FormObjs) 
and returns a triple 
<Plan, PlanFornmCbhjs, Plankestrict> 
such that: 


(i) H u PlanFormObjs contains all variables free in Plan 
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(ii) FormObJjJ3 ¢ PlanFormCbjs ¢ AllFormObjs 


(iii) Gt PlanRestrict >? (ri > [Plan] si) 
for 1<=i<=k 


(iv) Ge Plankestrict 2.Restrict 

(v) Gt (E PlanFormObjs) Plankestrict 
and treating this test as a guery, 
an answer exists in which each variable 
in PlanFormOb js is bound to a Single 
constant, plan parameter, or ¥-quantified 


variablee This condition shall be 
abbreviated as "Fx, 


Thus PlanRestrict specifies the sets of bindings for the formal 
objets which make the Plan a solution to the planning problem. 
Condition (v) insures that the planner knows of at least one 


suitable set of bindings. 


SOLVE(R,S) := BIGRESS(R,S, {(}), true) 
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BIGRESS(R, Sy, FormOb js, Restrict): 


If Gt rirPsi for 1<=i<=k then 
return <null, FormObjS, ReStrict>.e 


Choose: 
Choose <A, R/A> from LiveForward(R, FormOb js) 3 


<Subplan, NewFormOb js, NewRestrict> ‘:= 
BIGRESS(R/Ay S,; FormObjs, Restrict) 3 


return <A;Subplan, NewFormOb js, Newkestrict>. 
Choose <A,; R\A> from Livelackward(S, FormOb js) ; 


<Subplan, NewFormOb.js, NewRestrict> := 
BIGRESS(R, A\S, FormOb js, Restrict); 


return <Subplan;A, NewFormObjs, NewRestrict>. 


Choose <NewFormOb js, Newkestrict> from 
Nerge(FormOb js) 3 


return BIGRESS(R A NewRestrict, Sy 
FormOb js u NewFormObjsy, 
Restrict A NewRestrict). 
Choose NewRestrict from Diverge(FormOb js, Restrict) ; 
return BIGRESS(R A NewRestrict, 
S A NewRestrict, 
FormObjs, NewRestrict) e 


Choose TEST from NonTriv(R, FormOb Js) 3 


<Subl, NewForml, NewRest1>:= 
BIGRESS(R a TEST, Sy, FormObjs, Restrict); 


<Sub2, NewForm2, NewRes2>:= 
BIGRESS(R A ATEST a NewResl, Sy, NewForml, NewResl1); 


return <(TEST ~ Subl, Sub2), NewForm2, Newkes2). 


end BIGRESS 


LiveForward, LiveBackward, NontTriv: 


Same as before, except that memters of 
FormObjs may appear free in A or We 
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Merge (FormOb js)? 
return {(<NewFormCb js, NewRestrict> | 
NewFornObjs cc AllFormObjs - ForwCbjs 
NewRestrict e¢ kwfits(NewformOLbjs u FormO0bJjs) 
GE* (E NewFormUbjs) Newxestrict) . 
Diverge(lPormObjs, Restrict): 
return (NewRestrict | 
NewRestrict ¢€ kwfts(FormChjs) 
Gt NewRestrict > Restrict 
not Gt Restrict > NewRestrict 
GE* (E FornObjs) NewRestrict 
(not Gt -(Restrict a si)) 
dor 1<=i<=k} 
Merge introduces new formal objectSe eat selects an Rwit 


NewRestrict which constrains the values of the new objects only. 


These formal objects are then available to LivefForward, 
Livebackwat dy or NonTrive For example, Merge way return 
“tye l v £=C2>; BIGRESS~ can then choose <a(f), K/fal#t)> from 


Liveforward, merging the paths through a(Cl) and a(C2). 


Diverge increases the constraint on tne possible values of the 
currently available formal objects. This permits simplification of 
world descriptions and/or success of the stopping test. For 
exanpley shat Restrict is f=C1l v £=C2, and the portion ot the plan 
already found is al(f);b(2t), choosing a NewRestrict of F=Cl splits 
off the path through al(Cl);b(C1). Tie final condition in Diverve is 
a heuristic that avoids constraining the formal ob jects in such a 


way that the goal states become unobtainable. 


The modifications to the introduction of conditionals by 


RBIGRKESS are necessary to insure that both branches receive 
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compatible bindings for previously introduced formal objects. 


7e3 CORRECTNESS 


It is merely necessary to show that conditions (i) - (v) above 


holde 


(i) and (ii) are obviously trvuee PlanRestrict is simply the 
final parameter to BIGRKESS on its last recursive calle Diverge 
explicitly maintains conditions (iv) and (v), and it is readily seen 
that Merge does as well: 

(Restrict an NewRestrict) > Restrict 
is a tautology, and if 

Gt* (E NewFormCh js) NewRestrict 
and 

GH* (E FormObjs) Restrict 
then certainly 

GtE* (E NewFormCbjs)(E FormObjs) 


(Restrict an NewRestrict) 


Condition (iii) is proved by induction on WN, the number of 
calls to BIGRESS. Attach the phrase "for 1<=i<=k" after each 


formula involving ri and Si in the following sketche 


If N=1, then plan=null and Gt rixXrsie So for any formula 


PlanRestrict, Gt PlanRestrict>(ri >-[null]si). 


So suppose (iii) holds for any number of calls less than Ne 


The top level of BIGRESS chooses one of: 
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~-LiveForward: The recursive call constructs a Subplan such 


that 


Gt Plankestrict 3 (ri/A > [SubplanJsi) 


Gt [A])PlanRestrict 29 (ri > [A;Subplan)si) 
The reason for uSinag only invariant predicates in restriction wtfs 
becomes clear: it means that 

Gt PlanRestrict 2 [A] PlanRestrict 
so that we obtain the desired condition, 

Gt PlanFestrict = (ri > [A;Subplan)si) 
An interesting eeneralization may be to allow non-invariant 
predicates in restriction wftsS, and explicitly progress or regress 


the restriction through the action Ae 


~-LiveBackward, NontTriv: Are handled sSimilarlye 


--Merge: By the induction hypothesis, 


Gre PlanPestrict = (ri A NewKestrict 2[PlanJsi) 


Gt (Plankestrict a NewRestrict) > (ri 2[Plan]Jsi) 
By (iv), 

Gt Plankestrict > Restrict A Newkestrict 
Propositional reasoning allows us to derive 


Ge PlanRestrict > (ri >2[{Plan])si) 


--Diverge: Similar to Merge.e 
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7e4 INTELLIGENCE 


Some intelligence needs to be built into Merge and Diverge 
before they can add any "power" to BIGRESS. It is useful to 
introduce formal ob jects when the current LiveForward or 
LiveBackward sets contain a large number of actions which differ 
only in one or two farameterSe Heuristics could be included, for 
example, to introduce a formal object whose new restriction wff is a 
disjunction of equalities with each of these parameters, or is the 


proposition that the formal object is of the proper type to bea 


parameter of the action. 


The new restriction wff can Simply be true for tormal ob jects 
used in backwards searche The possible values for the formal object 
are "automatically" constrained by the regression proceSSe For 
example, suppose the sole dynamic axiom is: 

¥xy(pi(x) a p2(y) > Calxsy)] ql(x)) 
and s=q(C)- Then Merge can introduce a formal object f£ with 
NewRestrict=true, so that Restrict is unchangede Now 
al(C,f)\q(C) = pi(C) a p2(ft). In order to reach this new goal state, 


r2(f) must be be achieved. 


AS we saw in earlier examples, world descriptions become quite 
unwieldy when large numbers of free variables are present. Diverge 
can be selected in such cases to Simplify K and S. When a formal 
ob ject f is constrained to be equal to a single constant C, one can 
replace all instances ot t by C in R and Sy, and systematically 


evaluate the equality predicates in R and S which involve Ce 
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BIGRESS should know when a stronger restriction wft can lead 
immediately to a solution to the planninz problem. kach j;-osi tive 
answer to the query 

GE* (E FormObjs) (Restrict an (Restrict > (rirsi))) 
which holds across all the constraints can be used to construct such 
a restriction wif. This special case of Diverge could be 


efficiently incorporated in the stopping test itself. 


7eS EXAMPLE 


Use the level 1 dungeons world axioms. Let Res be 


loc(GOLD,LAIR) > [u] loc(GOLD, CAVE) 


BIGRESS(loc(GOLD,LAIR), Loc(GOLD,CAVE), {(), true) 
the set 


LiveForward( lLoc(GOLD,CAVE) ) 


contains transfer(GOLD,LAIR,x) for every room xe Instead of 
searchinng through transter(GOLD,LAIK,HOME), 
transfer (GOLD,LAIR, PIT), etce (until finally hitting on 


transfer (GOLD, LAIR,CAVE)) BIGRESS can choose 

<(ft}, room(f)> 
from Merge((})), and recursively call 

BIGRESS( Loc(GOLD,LAIR) A reom(£), Loc(GOLD,CAVE) )-. 
Then 

<transter(GOLD,LAIR,£f), loc(GOLD,4#) A room(f)> 
Should be chosen from 

LiveForward(loc(GOLD,LAIR) aA room(f)),; 


effectively merging all forward brancheSe The stopping test in 
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PIGRESS ( loc(GOLD,f£) A room(f),; loc(GCLD,CAVE) ) would be satisfied 
if f=CAVE; so BIGRESS should choose f=CAVE from 
Diverge({f}, room(f)). 
The innermost call 
BIGRESS( loc(GOLD,f) A room(f) A £=CAVE, loc(GOLD,CAVE) , 
(f}, room(F) a f=CAVE ) 
terminates the search, returning 


<transfer(GOLD,LAIR,f£), (£f}, room(f) A f=CAVE> 


7e6 SELECT STATEMENT 


The final restriction wff may be more general than a 

conjunction of equalitiese The plan constraint 

Loc(SWORD,CAVE) ={u] mloc(SWORD,CAVE) 
could lead to tne solution set 

<transfer (SWORD,CAVE,f>, {f£}, room(f) aA fACAVE> 
How Shall the planner make use of such a solution? It could 
immediately find a constant binding for f,») and substitute it into 
the plane But if this plan is to be incorporated into a larger 
sequence of actions, it may be more efficient in the long run to 
choose the bindings for formal objects at execution timee This can 
be done by inserting a new type of statement, select, at the 


beginning of the plane 


A select statement is written 
SEL(f1,---,fn) Res 
where the fi's are variables and Res is a nonmodal wff. We shall 


only admit a select as the first statement of a solution. 
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A solution set of the form 
<Plan,y PlanFormCObjs, Plankestrict> 
is transformable to the plan 
SEL (PlanFormObjs)PlanRestrict;Plan 
The solution to the example above can thus be written 
SEL(X) (room(f) a £#CAVE); transfer (SWCRD,CAVE,f) 
and we'd expect that 
loc(SWORD,CAVE) A[SEL(f) (room(t) A f£ACAVE); 
transfer (SWORD,CAVE,f) ] 
aloc(SWORT,CAVE) 
SEL can be given precise Semantics and axiomatics: 


M(SEL(f1,+¢.+-,%n) Res) = 


Cer.) 9) © dl w.asdn € DOMAIN such that 
(ay 11 Sew, dn/tn) 1 = J 
J|= Kee) 


({SEL(t1,--.,fn)Res]Q (¥ flyeeesy fn) (Res =) Q) 
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It is then easy to verify that if no formal objects appear in R (as 


on the first call to PIGRESS), that 
Gt Res > (R > [u] S) 

Prt | 
Gr R > {[SEL(FormCbjs)kKesj;u) S 
Gt <SEL(FormObjs)Res> true 

or equivalently 


Gt (E FormObjs) kes 


--which is a condition tor Res to be an acceptable restriction wff- 


Select is the only non-transparent action we've discussed, and 


as such really falls beyond the scope of the current papere 


complete development of the select action would lead 


into 


A more 


general 


FORMAL OBJECTS 


CHAPIER & 


CONCLUSIONS 


8-1 SUMMARY 


This thesis examined pianning formalisms and systems based on 
the situational calculus, state-Space models, and hierarchical 
problezsa decomposition, and their influence on Rosenschein's 


formulation of planninyg in propositional dynamic logic. 


I extended the formulation to Transparent Dynamic Logic, a 
special version of first-order da mantic logic which includes 
Peteciactear Ts cc actions and allows substitution of terms through nodal 
contextse Rosenschein'ts BIGRESS algorithn was extended for a subset 
of the lanvwuayve and froved correcte Goals and state descriptions 


could contain both quantified and disjunctive informatione 


A number of examples of single-level and hierarchical piannine 
problems were worked out which demonstrated the strengths of the 
dynamic logic approach over STRIPS, non-linear planners, and those 
with non-exact plan hierarchieSe Finally, an approach to the use of 


formal objects in the plan generation process was sketchede 
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&e2 FUTURE WORK 


The most gaping holes in the present work concern completeness 
of the progression and regression functionse We need a syntactic 
characterization of the first-order planning problems for which the 
answer-generation process can be guaranteed to find all significant 
answers and always terminatee Next, we need a proof (probably 
semantic) that the formula derived trom all the answers iS, in fact, 
the strongest provable postcondition (weakest provable 


precondition). 


Many extensions to the framework suggest themselves: 


It is desirable to be able to refer to entities for which no 
constant or plan parameter is knowne The present system cannot 
handle a command like, "pick up the block on the table". The Select 
action, discussed in Chapter 7, provides a mechanism for explicitly 
binding a variable to an entity which satisfies some description at 


a specified point in the plan. 


We made actions transparent by effectively banning non-rigid 
terms other than variablese It would be usetul in the Dungeons 
World to have a tern "location-of-robot" whose referent is changed 
by the "vo" action. But if any action is allowed to change the 
referent of any term, we could be stuck with frame axioms for the 


unchanged termSe 


Dynamic logic includes a transitive closure operator "x", not 
describeac in this thesis, which can be used with the ? and U 


operators to construct loopSe Wefd like to extend BIGRESS to 
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construct plans with loops, such as "Put all the blocks in BOXI1"', 
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or 
"Walk north until you reach CASTLEY". 
8e3 CONCLUVING REMARKS 

No attempt has been made to implement the system described in 
this thesise* A practical implementation must caretully control the 
amount of theorem proving performed in the stopping test and 
progression and regression functions. Although frame axioms are 
given a uniform fornal treatment with other dynamic axioms, the 
theorem prover should limit their role in the resolution proceSs; as 
Suguested in section 4e5-46c-6 It renains very costly to handle 
equality in full Bpenerality; a preliminary implementation may 


prohibit the use of existentially~quantified variables and plan 


parameters, thus eliminating the need tor frame axioms for equalitye 


Still, the dynamic logic tramework is useful if only for 


its 


ability to describe and formalize various approaches to the planning 


probleme The world does not need another progran that solves 


the 


three-block problen; an elegant, increnentally extendable theory of 


planning is of considerahle intereste 


mm ee se ee ee ee re ee ee 


*An Liaplenentation based on an extension of the propoSitional 
framework to propositional schemata has been completed at SRI; 


details are expected to appear in [Rosenschein (forthcoming) ]- 
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